2025-04-02 02:52:57,980 [ 479654 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:53, check_args_and_update_paths) 2025-04-02 02:52:57,980 [ 479654 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:97, check_args_and_update_paths) 2025-04-02 02:52:57,980 [ 479654 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:108, check_args_and_update_paths) 2025-04-02 02:52:57,980 [ 479654 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:110, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_egzw3g --privileged --dns-search='.' --memory=30709035008 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=8b2301119731 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots test_postgresql_replica_database_engine_1/test.py::test_virtual_columns test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_remote_prewhere/test.py::test_remote test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16]' 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12]' test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replicated_user_defined_functions/test.py::test_create_and_drop 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1]' 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0]' test_replicated_user_defined_functions/test.py::test_create_and_replace test_replicated_user_defined_functions/test.py::test_drop_if_exists test_replicated_user_defined_functions/test.py::test_reload_zookeeper test_replicated_user_defined_functions/test.py::test_replication test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation test_replicated_user_defined_functions/test.py::test_server_restart test_replicated_user_defined_functions/test.py::test_start_without_zookeeper test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_s3_imds/test_session_token.py::test_credentials_from_metadata test_s3_imds/test_simple.py::test_credentials_from_metadata test_s3_latency_log/test.py::test_latency_log test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver]' test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy test_scheduler/test.py::test_create_workload test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_resource_any_disk test_scheduler/test.py::test_resource_read_and_write test_scheduler/test.py::test_s3_disk test_scheduler/test.py::test_s3_resource_request_granularity test_scheduler/test.py::test_throw_on_unknown_workload test_scheduler/test.py::test_workload_entity_keeper_storage test_scheduler/test.py::test_workload_hierarchy_changes test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings -vvv -ss" altinityinfra/integration-tests-runner:2165613c5fcd '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache Test order randomisation NOT enabled. Enable with --random-order or --random-order-bucket= rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: timeout-2.3.1, repeat-0.9.3, order-1.0.0, reportlog-0.4.0, xdist-3.5.0, random-order-1.1.1 timeout: 900.0s timeout method: signal timeout func_only: False created: 10/10 workers 10 workers [100 items] scheduling tests via LoadFileScheduling Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] Command:[docker ps | wc -l] test_scheduler/test.py::test_create_workload test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_rename_column/test.py::test_rename_distributed test_replicated_user_defined_functions/test.py::test_create_and_drop test_reload_clusters_config/test.py::test_add_cluster test_rocksdb_options/test.py::test_invalid_block_based_table_options test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_reload_client_certificate/test.py::test_correct_cn_cert Stdout:1 Stdout:1 Stdout:1 No running containers Stdout:1 No running containers No running containers No running containers Pruning Docker networks Pruning Docker networks Pruning Docker networks Pruning Docker networks Command:[docker network prune --force] Command:[docker network prune --force] Command:[docker network prune --force] Command:[docker network prune --force] Stdout:1 Stdout:1 No running containers No running containers Pruning Docker networks Pruning Docker networks Command:[docker network prune --force] Command:[docker network prune --force] Stdout:1 Stdout:1 No running containers No running containers Pruning Docker networks Pruning Docker networks Command:[docker network prune --force] Command:[docker network prune --force] Stdout:1 Stdout:1 No running containers No running containers Pruning Docker networks Pruning Docker networks Command:[docker network prune --force] Command:[docker network prune --force] Stdout:1 Stdout:1 Stdout:1 No running containers No running containers Stdout:1 Pruning Docker networks Pruning Docker networks Command:[docker network prune --force] No running containers No running containers Pruning Docker networks Pruning Docker networks Command:[docker network prune --force] Command:[docker network prune --force] Stdout:1 Stdout:1 No running containers Command:[docker network prune --force] No running containers Pruning Docker networks Pruning Docker networks Stdout:1 Stdout:1 No running containers No running containers Command:[docker network prune --force] Command:[docker network prune --force] Pruning Docker networks Pruning Docker networks Command:[docker network prune --force] Command:[docker network prune --force] Stdout:1 Stdout:1 No running containers No running containers Pruning Docker networks Pruning Docker networks Command:[docker network prune --force] Command:[docker network prune --force] Stderr:Error response from daemon: a prune operation is already running Stderr:Error response from daemon: a prune operation is already running Exitcode:1 Exitcode:1 Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Stderr:Error response from daemon: a prune operation is already running Stderr:Error response from daemon: a prune operation is already running Exitcode:1 Exitcode:1 Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Stderr:Error response from daemon: a prune operation is already running Stderr:Error response from daemon: a prune operation is already running Exitcode:1 Exitcode:1 Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Stderr:Error response from daemon: a prune operation is already running Stderr:Error response from daemon: a prune operation is already running Exitcode:1 Exitcode:1 Stdout:net.ipv4.ip_local_port_range = 55000 65535 Stdout:net.ipv4.ip_local_port_range = 55000 65535 Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Running tests in /ClickHouse/tests/integration/test_rename_column/test.py Running tests in /ClickHouse/tests/integration/test_rename_column/test.py Cluster start called. is_up=False Cluster start called. is_up=False Stdout:net.ipv4.ip_local_port_range = 55000 65535 Stdout:net.ipv4.ip_local_port_range = 55000 65535 ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true Stderr:Error response from daemon: a prune operation is already running Stderr:Error response from daemon: a prune operation is already running Exitcode:1 Exitcode:1 Stderr:Error response from daemon: a prune operation is already running Stderr:Error response from daemon: a prune operation is already running Stdout:net.ipv4.ip_local_port_range = 55000 65535 Stdout:net.ipv4.ip_local_port_range = 55000 65535 Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Exitcode:1 Exitcode:1 Stderr:Error response from daemon: a prune operation is already running Stderr:Error response from daemon: a prune operation is already running ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse Exitcode:1 Exitcode:1 ENV HOSTNAME 3624a24af23d ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV HOSTNAME 3624a24af23d ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV SHLVL 0 ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV SHLVL 0 Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV HOME /root ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV HOME /root Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] ENV HOSTNAME 3624a24af23d ENV OLDPWD / ENV HOSTNAME 3624a24af23d ENV OLDPWD / ENV SHLVL 0 ENV DOCKER_HELPER_TAG 5dc43a6382f0 ENV SHLVL 0 ENV DOCKER_HELPER_TAG 5dc43a6382f0 ENV HOME /root ENV PYTHONUNBUFFERED 1 ENV PYTHONUNBUFFERED 1 ENV HOME /root ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e ENV OLDPWD / Stderr:Error response from daemon: a prune operation is already running ENV OLDPWD / Stderr:Error response from daemon: a prune operation is already running ENV UBSAN_OPTIONS print_stacktrace=1 ENV DOCKER_HELPER_TAG 5dc43a6382f0 ENV DOCKER_HELPER_TAG 5dc43a6382f0 ENV UBSAN_OPTIONS print_stacktrace=1 ENV PYTHONUNBUFFERED 1 ENV PYTHONUNBUFFERED 1 Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots test_postgresql_replica_database_engine_1/test.py::test_virtual_columns test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_remote_prewhere/test.py::test_remote test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16]' 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12]' test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replicated_user_defined_functions/test.py::test_create_and_drop 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1]' 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0]' test_replicated_user_defined_functions/test.py::test_create_and_replace test_replicated_user_defined_functions/test.py::test_drop_if_exists test_replicated_user_defined_functions/test.py::test_reload_zookeeper test_replicated_user_defined_functions/test.py::test_replication test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation test_replicated_user_defined_functions/test.py::test_server_restart test_replicated_user_defined_functions/test.py::test_start_without_zookeeper test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_s3_imds/test_session_token.py::test_credentials_from_metadata test_s3_imds/test_simple.py::test_credentials_from_metadata test_s3_latency_log/test.py::test_latency_log test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver]' test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy test_scheduler/test.py::test_create_workload test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_resource_any_disk test_scheduler/test.py::test_resource_read_and_write test_scheduler/test.py::test_s3_disk test_scheduler/test.py::test_s3_resource_request_granularity test_scheduler/test.py::test_throw_on_unknown_workload test_scheduler/test.py::test_workload_entity_keeper_storage test_scheduler/test.py::test_workload_hierarchy_changes test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings -vvv -ss ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots test_postgresql_replica_database_engine_1/test.py::test_virtual_columns test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_remote_prewhere/test.py::test_remote test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16]' 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12]' test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replicated_user_defined_functions/test.py::test_create_and_drop 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1]' 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0]' test_replicated_user_defined_functions/test.py::test_create_and_replace test_replicated_user_defined_functions/test.py::test_drop_if_exists test_replicated_user_defined_functions/test.py::test_reload_zookeeper test_replicated_user_defined_functions/test.py::test_replication test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation test_replicated_user_defined_functions/test.py::test_server_restart test_replicated_user_defined_functions/test.py::test_start_without_zookeeper test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_s3_imds/test_session_token.py::test_credentials_from_metadata test_s3_imds/test_simple.py::test_credentials_from_metadata test_s3_latency_log/test.py::test_latency_log test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver]' test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy test_scheduler/test.py::test_create_workload test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_resource_any_disk test_scheduler/test.py::test_resource_read_and_write test_scheduler/test.py::test_s3_disk test_scheduler/test.py::test_s3_resource_request_granularity test_scheduler/test.py::test_throw_on_unknown_workload test_scheduler/test.py::test_workload_entity_keeper_storage test_scheduler/test.py::test_workload_hierarchy_changes test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings -vvv -ss Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge ENV UBSAN_OPTIONS print_stacktrace=1 ENV UBSAN_OPTIONS print_stacktrace=1 ENV COMPOSE_HTTP_TIMEOUT 600 ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots test_postgresql_replica_database_engine_1/test.py::test_virtual_columns test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_remote_prewhere/test.py::test_remote test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16]' 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12]' test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replicated_user_defined_functions/test.py::test_create_and_drop 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1]' 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0]' test_replicated_user_defined_functions/test.py::test_create_and_replace test_replicated_user_defined_functions/test.py::test_drop_if_exists test_replicated_user_defined_functions/test.py::test_reload_zookeeper test_replicated_user_defined_functions/test.py::test_replication test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation test_replicated_user_defined_functions/test.py::test_server_restart test_replicated_user_defined_functions/test.py::test_start_without_zookeeper test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_s3_imds/test_session_token.py::test_credentials_from_metadata test_s3_imds/test_simple.py::test_credentials_from_metadata test_s3_latency_log/test.py::test_latency_log test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver]' test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy test_scheduler/test.py::test_create_workload test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_resource_any_disk test_scheduler/test.py::test_resource_read_and_write test_scheduler/test.py::test_s3_disk test_scheduler/test.py::test_s3_resource_request_granularity test_scheduler/test.py::test_throw_on_unknown_workload test_scheduler/test.py::test_workload_entity_keeper_storage test_scheduler/test.py::test_workload_hierarchy_changes test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings -vvv -ss ENV COMPOSE_HTTP_TIMEOUT 600 ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots test_postgresql_replica_database_engine_1/test.py::test_virtual_columns test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_remote_prewhere/test.py::test_remote test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16]' 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12]' test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replicated_user_defined_functions/test.py::test_create_and_drop 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1]' 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0]' test_replicated_user_defined_functions/test.py::test_create_and_replace test_replicated_user_defined_functions/test.py::test_drop_if_exists test_replicated_user_defined_functions/test.py::test_reload_zookeeper test_replicated_user_defined_functions/test.py::test_replication test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation test_replicated_user_defined_functions/test.py::test_server_restart test_replicated_user_defined_functions/test.py::test_start_without_zookeeper test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_s3_imds/test_session_token.py::test_credentials_from_metadata test_s3_imds/test_simple.py::test_credentials_from_metadata test_s3_latency_log/test.py::test_latency_log test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver]' test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy test_scheduler/test.py::test_create_workload test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_resource_any_disk test_scheduler/test.py::test_resource_read_and_write test_scheduler/test.py::test_s3_disk test_scheduler/test.py::test_s3_resource_request_granularity test_scheduler/test.py::test_throw_on_unknown_workload test_scheduler/test.py::test_workload_entity_keeper_storage test_scheduler/test.py::test_workload_hierarchy_changes test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings -vvv -ss ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge Exitcode:1 Exitcode:1 ENV COMPOSE_HTTP_TIMEOUT 600 ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV COMPOSE_HTTP_TIMEOUT 600 ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV DOCKER_CHANNEL stable ENV DOCKER_CHANNEL stable ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV DOCKER_CLIENT_TIMEOUT 300 ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_CLIENT_TIMEOUT 300 Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_CHANNEL stable ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_CHANNEL stable Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV DOCKER_CLIENT_TIMEOUT 300 ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV DOCKER_CLIENT_TIMEOUT 300 ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV PWD /ClickHouse/tests/integration ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV PWD /ClickHouse/tests/integration ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge ENV PWD /ClickHouse/tests/integration ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge ENV PWD /ClickHouse/tests/integration ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV TZ Etc/UTC ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge ENV TZ Etc/UTC ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV DOCKER_BASE_TAG 8b2301119731 ENV TZ Etc/UTC ENV DOCKER_BASE_TAG 8b2301119731 ENV TZ Etc/UTC ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV LC_CTYPE C.UTF-8 ENV DOCKER_BASE_TAG 8b2301119731 ENV LC_CTYPE C.UTF-8 ENV DOCKER_BASE_TAG 8b2301119731 ENV INTEGRATION_TESTS_RUN_ID 0 ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV INTEGRATION_TESTS_RUN_ID 0 ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV WORKER_FREE_PORTS 30300 30301 30302 30303 30304 30305 30306 30307 30308 30309 30310 30311 30312 30313 30314 30315 30316 30317 30318 30319 30320 30321 30322 30323 30324 30325 30326 30327 30328 30329 30330 30331 30332 30333 30334 30335 30336 30337 30338 30339 30340 30341 30342 30343 30344 30345 30346 30347 30348 30349 ENV LC_CTYPE C.UTF-8 ENV WORKER_FREE_PORTS 30300 30301 30302 30303 30304 30305 30306 30307 30308 30309 30310 30311 30312 30313 30314 30315 30316 30317 30318 30319 30320 30321 30322 30323 30324 30325 30326 30327 30328 30329 30330 30331 30332 30333 30334 30335 30336 30337 30338 30339 30340 30341 30342 30343 30344 30345 30346 30347 30348 30349 ENV LC_CTYPE C.UTF-8 ENV INTEGRATION_TESTS_RUN_ID 0 ENV PYTEST_XDIST_TESTRUNUID c5ba503209524253afe87e95762d6d1b ENV PYTEST_XDIST_TESTRUNUID c5ba503209524253afe87e95762d6d1b ENV INTEGRATION_TESTS_RUN_ID 0 ENV PYTEST_XDIST_WORKER gw6 ENV WORKER_FREE_PORTS 30200 30201 30202 30203 30204 30205 30206 30207 30208 30209 30210 30211 30212 30213 30214 30215 30216 30217 30218 30219 30220 30221 30222 30223 30224 30225 30226 30227 30228 30229 30230 30231 30232 30233 30234 30235 30236 30237 30238 30239 30240 30241 30242 30243 30244 30245 30246 30247 30248 30249 ENV PYTEST_XDIST_WORKER gw6 ENV WORKER_FREE_PORTS 30200 30201 30202 30203 30204 30205 30206 30207 30208 30209 30210 30211 30212 30213 30214 30215 30216 30217 30218 30219 30220 30221 30222 30223 30224 30225 30226 30227 30228 30229 30230 30231 30232 30233 30234 30235 30236 30237 30238 30239 30240 30241 30242 30243 30244 30245 30246 30247 30248 30249 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV PYTEST_XDIST_TESTRUNUID c5ba503209524253afe87e95762d6d1b ENV PYTEST_XDIST_TESTRUNUID c5ba503209524253afe87e95762d6d1b ENV PYTEST_CURRENT_TEST test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table (setup) ENV PYTEST_CURRENT_TEST test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table (setup) ENV PYTEST_XDIST_WORKER gw4 ENV PYTEST_XDIST_WORKER gw4 Stdout:net.ipv4.ip_local_port_range = 55000 65535 ENV PYTEST_XDIST_WORKER_COUNT 10 Stdout:net.ipv4.ip_local_port_range = 55000 65535 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV PYTEST_CURRENT_TEST test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy (setup) ENV PYTEST_CURRENT_TEST test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy (setup) Stdout:net.ipv4.ip_local_port_range = 55000 65535 Stdout:net.ipv4.ip_local_port_range = 55000 65535 CLUSTER INIT base_config_dir:/clickhouse-config CLUSTER INIT base_config_dir:/clickhouse-config Running tests in /ClickHouse/tests/integration/test_rocksdb_options/test.py clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Running tests in /ClickHouse/tests/integration/test_rocksdb_options/test.py clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log CLUSTER INIT base_config_dir:/clickhouse-config CLUSTER INIT base_config_dir:/clickhouse-config Setup Keeper Stdout:net.ipv4.ip_local_port_range = 55000 65535 Setup Keeper Cluster start called. is_up=False Cluster start called. is_up=False Stdout:net.ipv4.ip_local_port_range = 55000 65535 clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Cluster name: project_name:roottestreplicatedmergetrees3zerocopy-gw6. Added instance name:node1 tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/.env', '--project-name', 'roottestreplicatedmergetrees3zerocopy-gw6', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottestreplicatedmergetrees3zerocopy-gw6. Added instance name:node1 tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/.env', '--project-name', 'roottestreplicatedmergetrees3zerocopy-gw6', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Cluster name: project_name:roottests3tablefunctionwithhttpproxy-gw4. Added instance name:remote_proxy_node tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/.env', '--project-name', 'roottests3tablefunctionwithhttpproxy-gw4', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottests3tablefunctionwithhttpproxy-gw4. Added instance name:remote_proxy_node tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/.env', '--project-name', 'roottests3tablefunctionwithhttpproxy-gw4', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Running tests in /ClickHouse/tests/integration/test_reload_client_certificate/test.py Running tests in /ClickHouse/tests/integration/test_reload_client_certificate/test.py clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Cluster name: project_name:roottestreplicatedmergetrees3zerocopy-gw6. Added instance name:node2 tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/.env', '--project-name', 'roottestreplicatedmergetrees3zerocopy-gw6', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node2/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottestreplicatedmergetrees3zerocopy-gw6. Added instance name:node2 tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/.env', '--project-name', 'roottestreplicatedmergetrees3zerocopy-gw6', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node2/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Cluster start called. is_up=False Cluster name: project_name:roottests3tablefunctionwithhttpproxy-gw4. Added instance name:remote_proxy_node_no_proxy tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/.env', '--project-name', 'roottests3tablefunctionwithhttpproxy-gw4', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node_no_proxy/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster start called. is_up=False Cluster name: project_name:roottests3tablefunctionwithhttpproxy-gw4. Added instance name:remote_proxy_node_no_proxy tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/.env', '--project-name', 'roottests3tablefunctionwithhttpproxy-gw4', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node_no_proxy/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottestreplicatedmergetrees3zerocopy-gw6. Added instance name:node3 tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/.env', '--project-name', 'roottestreplicatedmergetrees3zerocopy-gw6', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node3/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottestreplicatedmergetrees3zerocopy-gw6. Added instance name:node3 tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/.env', '--project-name', 'roottestreplicatedmergetrees3zerocopy-gw6', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node3/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Starting cluster... Starting cluster... Cluster name: project_name:roottests3tablefunctionwithhttpproxy-gw4. Added instance name:proxy_list_node tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/.env', '--project-name', 'roottests3tablefunctionwithhttpproxy-gw4', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottests3tablefunctionwithhttpproxy-gw4. Added instance name:proxy_list_node tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/.env', '--project-name', 'roottests3tablefunctionwithhttpproxy-gw4', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Running tests in /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/test.py Running tests in /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/test.py Running tests in /ClickHouse/tests/integration/test_reload_clusters_config/test.py Running tests in /ClickHouse/tests/integration/test_reload_clusters_config/test.py Cluster name: project_name:roottests3tablefunctionwithhttpproxy-gw4. Added instance name:proxy_list_node_no_proxy tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/.env', '--project-name', 'roottests3tablefunctionwithhttpproxy-gw4', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node_no_proxy/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottests3tablefunctionwithhttpproxy-gw4. Added instance name:proxy_list_node_no_proxy tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/.env', '--project-name', 'roottests3tablefunctionwithhttpproxy-gw4', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node_no_proxy/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Cluster start called. is_up=False Cluster start called. is_up=False clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Cluster start called. is_up=False Cluster start called. is_up=False Cluster name: project_name:roottests3tablefunctionwithhttpproxy-gw4. Added instance name:env_node tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/.env', '--project-name', 'roottests3tablefunctionwithhttpproxy-gw4', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottests3tablefunctionwithhttpproxy-gw4. Added instance name:env_node tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/.env', '--project-name', 'roottests3tablefunctionwithhttpproxy-gw4', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Cluster name: project_name:roottests3tablefunctionwithhttpproxy-gw4. Added instance name:env_node_no_proxy tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/.env', '--project-name', 'roottests3tablefunctionwithhttpproxy-gw4', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node_no_proxy/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottests3tablefunctionwithhttpproxy-gw4. Added instance name:env_node_no_proxy tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/.env', '--project-name', 'roottests3tablefunctionwithhttpproxy-gw4', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node_no_proxy/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node_no_proxy/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Starting cluster... Starting cluster... Running tests in /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/test.py Running tests in /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/test.py Cluster start called. is_up=False Cluster start called. is_up=False Stdout:net.ipv4.ip_local_port_range = 55000 65535 Stdout:net.ipv4.ip_local_port_range = 55000 65535 Stdout:net.ipv4.ip_local_port_range = 55000 65535 Stdout:net.ipv4.ip_local_port_range = 55000 65535 Running tests in /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/test.py Running tests in /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/test.py Running tests in /ClickHouse/tests/integration/test_replicated_user_defined_functions/test.py Running tests in /ClickHouse/tests/integration/test_replicated_user_defined_functions/test.py Cluster start called. is_up=False Cluster start called. is_up=False Cluster start called. is_up=False Cluster start called. is_up=False Stderr:Error response from daemon: a prune operation is already running Stderr:Error response from daemon: a prune operation is already running Exitcode:1 Exitcode:1 Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Stdout:net.ipv4.ip_local_port_range = 55000 65535 Stdout:net.ipv4.ip_local_port_range = 55000 65535 Running tests in /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/test.py Running tests in /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottestrenamecolumn-gw3 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestrenamecolumn-gw3 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreloadclientcertificate-gw9 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreloadclientcertificate-gw9 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedmergetrees3zerocopy-gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedmergetrees3zerocopy-gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicateduserdefinedfunctions-gw2 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicateduserdefinedfunctions-gw2 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreloadclustersconfig-gw8 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreloadclustersconfig-gw8 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestrocksdboptions-gw5 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestrocksdboptions-gw5 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3lowcardinalityrightborder-gw7 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3lowcardinalityrightborder-gw7 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3tablefunctionwithhttpproxy-gw4 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3tablefunctionwithhttpproxy-gw4 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestpostgresqlreplicadatabaseengine1-gw0 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestpostgresqlreplicadatabaseengine1-gw0 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestrenamecolumn-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestrenamecolumn-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicateduserdefinedfunctions-gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicateduserdefinedfunctions-gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreloadclientcertificate-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreloadclientcertificate-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreloadclustersconfig-gw8 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreloadclustersconfig-gw8 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestrocksdboptions-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestrocksdboptions-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3tablefunctionwithhttpproxy-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3tablefunctionwithhttpproxy-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3lowcardinalityrightborder-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3lowcardinalityrightborder-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestpostgresqlreplicadatabaseengine1-gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestpostgresqlreplicadatabaseengine1-gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedmergetrees3zerocopy-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedmergetrees3zerocopy-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestrenamecolumn-gw3 are DRIVER VOLUME NAME Docker volumes for project roottestrenamecolumn-gw3 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker volumes for project roottestreloadclientcertificate-gw9 are DRIVER VOLUME NAME Docker volumes for project roottestreloadclientcertificate-gw9 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker volumes for project roottestreplicateduserdefinedfunctions-gw2 are DRIVER VOLUME NAME Docker volumes for project roottestreplicateduserdefinedfunctions-gw2 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker volumes for project roottestreloadclustersconfig-gw8 are DRIVER VOLUME NAME Docker volumes for project roottestreloadclustersconfig-gw8 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker volumes for project roottestrocksdboptions-gw5 are DRIVER VOLUME NAME Docker volumes for project roottestrocksdboptions-gw5 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker volumes for project roottestpostgresqlreplicadatabaseengine1-gw0 are DRIVER VOLUME NAME Docker volumes for project roottestpostgresqlreplicadatabaseengine1-gw0 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker volumes for project roottests3lowcardinalityrightborder-gw7 are DRIVER VOLUME NAME Docker volumes for project roottests3lowcardinalityrightborder-gw7 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker volumes for project roottests3tablefunctionwithhttpproxy-gw4 are DRIVER VOLUME NAME Docker volumes for project roottests3tablefunctionwithhttpproxy-gw4 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker volumes for project roottestreplicatedmergetrees3zerocopy-gw6 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedmergetrees3zerocopy-gw6 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottestrenamecolumn-gw3 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestrenamecolumn-gw3 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreloadclientcertificate-gw9 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreloadclientcertificate-gw9 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicateduserdefinedfunctions-gw2 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicateduserdefinedfunctions-gw2 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestrocksdboptions-gw5 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestrocksdboptions-gw5 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreloadclustersconfig-gw8 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreloadclustersconfig-gw8 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestpostgresqlreplicadatabaseengine1-gw0 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestpostgresqlreplicadatabaseengine1-gw0 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedmergetrees3zerocopy-gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedmergetrees3zerocopy-gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3lowcardinalityrightborder-gw7 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3lowcardinalityrightborder-gw7 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3tablefunctionwithhttpproxy-gw4 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3tablefunctionwithhttpproxy-gw4 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestrenamecolumn-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestrenamecolumn-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicateduserdefinedfunctions-gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicateduserdefinedfunctions-gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreloadclientcertificate-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreloadclientcertificate-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreloadclustersconfig-gw8 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreloadclustersconfig-gw8 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestpostgresqlreplicadatabaseengine1-gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestpostgresqlreplicadatabaseengine1-gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedmergetrees3zerocopy-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedmergetrees3zerocopy-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3tablefunctionwithhttpproxy-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3tablefunctionwithhttpproxy-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3lowcardinalityrightborder-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3lowcardinalityrightborder-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestrenamecolumn-gw3 are DRIVER VOLUME NAME Docker volumes for project roottestrenamecolumn-gw3 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestrenamecolumn-gw3-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestrenamecolumn-gw3-.*-1$' --format '{{.ID}}:{{.Names}}'] Docker containers for project roottestrocksdboptions-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestrocksdboptions-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicateduserdefinedfunctions-gw2 are DRIVER VOLUME NAME Docker volumes for project roottestreplicateduserdefinedfunctions-gw2 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreplicateduserdefinedfunctions-gw2-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreplicateduserdefinedfunctions-gw2-.*-1$' --format '{{.ID}}:{{.Names}}'] Docker volumes for project roottestreloadclientcertificate-gw9 are DRIVER VOLUME NAME Docker volumes for project roottestreloadclientcertificate-gw9 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreloadclientcertificate-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreloadclientcertificate-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Docker volumes for project roottestreloadclustersconfig-gw8 are DRIVER VOLUME NAME Docker volumes for project roottestreloadclustersconfig-gw8 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreloadclustersconfig-gw8-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreloadclustersconfig-gw8-.*-1$' --format '{{.ID}}:{{.Names}}'] Docker volumes for project roottestpostgresqlreplicadatabaseengine1-gw0 are DRIVER VOLUME NAME Docker volumes for project roottestpostgresqlreplicadatabaseengine1-gw0 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestpostgresqlreplicadatabaseengine1-gw0-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestpostgresqlreplicadatabaseengine1-gw0-.*-1$' --format '{{.ID}}:{{.Names}}'] Docker volumes for project roottestreplicatedmergetrees3zerocopy-gw6 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedmergetrees3zerocopy-gw6 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreplicatedmergetrees3zerocopy-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreplicatedmergetrees3zerocopy-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Docker volumes for project roottests3lowcardinalityrightborder-gw7 are DRIVER VOLUME NAME Docker volumes for project roottestrocksdboptions-gw5 are DRIVER VOLUME NAME Docker volumes for project roottestrocksdboptions-gw5 are DRIVER VOLUME NAME Docker volumes for project roottests3lowcardinalityrightborder-gw7 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestrocksdboptions-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3lowcardinalityrightborder-gw7-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3lowcardinalityrightborder-gw7-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestrocksdboptions-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestrenamecolumn-gw3 No running containers for project: roottestrenamecolumn-gw3 Trying to prune unused networks... Trying to prune unused networks... Docker volumes for project roottests3tablefunctionwithhttpproxy-gw4 are DRIVER VOLUME NAME Docker volumes for project roottests3tablefunctionwithhttpproxy-gw4 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3tablefunctionwithhttpproxy-gw4-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3tablefunctionwithhttpproxy-gw4-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicateduserdefinedfunctions-gw2 No running containers for project: roottestreplicateduserdefinedfunctions-gw2 Trying to prune unused networks... Trying to prune unused networks... Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreloadclustersconfig-gw8 No running containers for project: roottestreloadclustersconfig-gw8 Trying to prune unused networks... Trying to prune unused networks... Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreloadclientcertificate-gw9 No running containers for project: roottestreloadclientcertificate-gw9 Trying to prune unused networks... Trying to prune unused networks... Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicatedmergetrees3zerocopy-gw6 No running containers for project: roottestreplicatedmergetrees3zerocopy-gw6 Trying to prune unused networks... Trying to prune unused networks... Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestrocksdboptions-gw5 No running containers for project: roottestrocksdboptions-gw5 Trying to prune unused networks... Trying to prune unused networks... Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestpostgresqlreplicadatabaseengine1-gw0 No running containers for project: roottestpostgresqlreplicadatabaseengine1-gw0 Trying to prune unused images... Trying to prune unused images... Trying to prune unused networks... Trying to prune unused networks... Command:[docker image prune -f] Command:[docker image prune -f] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3lowcardinalityrightborder-gw7 No running containers for project: roottests3lowcardinalityrightborder-gw7 Trying to prune unused networks... Trying to prune unused networks... Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3tablefunctionwithhttpproxy-gw4 No running containers for project: roottests3tablefunctionwithhttpproxy-gw4 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stderr:Error response from daemon: a prune operation is already running Stderr:Error response from daemon: a prune operation is already running Stderr:Error response from daemon: a prune operation is already running Stderr:Error response from daemon: a prune operation is already running Exitcode:1 Exitcode:1 Exitcode:1 Exitcode:1 Stdout:Total reclaimed space: 0B Trying to prune unused volumes... Trying to prune unused volumes... Trying to prune unused volumes... Trying to prune unused volumes... Stdout:Total reclaimed space: 0B Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stderr:Error response from daemon: a prune operation is already running Stderr:Error response from daemon: a prune operation is already running Exitcode:1 Exitcode:1 Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stderr:Error response from daemon: a prune operation is already running Stderr:Error response from daemon: a prune operation is already running Exitcode:1 Exitcode:1 Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:1 Stdout:1 Volumes pruned: 1 Volumes pruned: 1 Setup directory for instance: node1 Setup directory for instance: node1 Stdout:1 Stdout:1 Stdout:1 Stdout:1 Volumes pruned: 1 Volumes pruned: 1 Setup directory for instance: node1 Setup directory for instance: node1 Volumes pruned: 1 Volumes pruned: 1 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Setup directory for instance: node1 Setup directory for instance: node1 Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Create directory for configuration generated in this helper Create directory for configuration generated in this helper Generate and write macros file Generate and write macros file Copy common configuration from helpers Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Stdout:1 Stdout:1 Volumes pruned: 1 Volumes pruned: 1 Copy common configuration from helpers Copy common configuration from helpers Setup directory for instance: node1 Setup directory for instance: node1 Stdout:1 Copy custom test config files ['/ClickHouse/tests/integration/test_rename_column/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/instant_moves.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/part_log.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/zookeeper_session_timeout.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/storage_configuration.xml'] to /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node1/configs/config.d Stdout:1 Copy custom test config files ['/ClickHouse/tests/integration/test_rename_column/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/instant_moves.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/part_log.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/zookeeper_session_timeout.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/storage_configuration.xml'] to /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node1/configs/config.d Generate and write macros file Generate and write macros file Generate and write macros file Generate and write macros file Create directory for configuration generated in this helper Create directory for configuration generated in this helper Volumes pruned: 1 Volumes pruned: 1 Create directory for common tests configuration Create directory for common tests configuration Setup directory for instance: node Copy custom test config files ['/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/first_client.crt', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/first_client.key', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/second_client.crt', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/second_client.key', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/third_client.crt', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/third_client.key', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/conf.d/remote_servers.xml', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/conf.d/ssl_conf.xml', '/ClickHouse/tests/integration/test_reload_client_certificate/configs/zookeeper_config_with_ssl.xml'] to /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node1/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/first_client.crt', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/first_client.key', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/second_client.crt', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/second_client.key', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/third_client.crt', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/third_client.key', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/conf.d/remote_servers.xml', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/conf.d/ssl_conf.xml', '/ClickHouse/tests/integration/test_reload_client_certificate/configs/zookeeper_config_with_ssl.xml'] to /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node1/configs/config.d Setup directory for instance: node Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/configs/config.d/storage_conf.xml'] to /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node1/configs/config.d Copy common configuration from helpers Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/configs/config.d/storage_conf.xml'] to /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node1/configs/config.d Copy common configuration from helpers Generate and write macros file Generate and write macros file Create directory for configuration generated in this helper Copy custom test config files ['/ClickHouse/tests/integration/test_s3_low_cardinality_right_border/configs/s3.xml'] to /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/node1/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_s3_low_cardinality_right_border/configs/s3.xml'] to /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/node1/configs/config.d Create directory for configuration generated in this helper Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node1/database Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node1/database Create directory for common tests configuration Create directory for common tests configuration Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node1/logs Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node1/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Setup database dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node1/database Setup database dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node1/database Setup database dir /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/node1/database Setup database dir /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/node1/database Setup directory for instance: node2 Setup directory for instance: node2 Setup logs dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node1/logs Setup logs dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node1/logs Setup logs dir /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/node1/logs Setup logs dir /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/node1/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Copy common configuration from helpers Copy common configuration from helpers Setup directory for instance: node2 Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/.env Setup directory for instance: node2 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Create directory for common tests configuration Create directory for common tests configuration No config file found No config file found Create directory for configuration generated in this helper Create directory for configuration generated in this helper Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Copy common configuration from helpers No config file found Create directory for common tests configuration No config file found Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Copy common configuration from helpers Generate and write macros file Setup database dir /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node1/database Copy custom test config files ['/ClickHouse/tests/integration/test_rocksdb_options/configs/rocksdb.xml'] to /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/node/configs/config.d Setup database dir /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node1/database Copy custom test config files ['/ClickHouse/tests/integration/test_rocksdb_options/configs/rocksdb.xml'] to /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/node/configs/config.d Generate and write macros file Generate and write macros file Generate and write macros file Generate and write macros file Setup logs dir /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node1/logs Setup logs dir /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node1/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/configs/config.d/storage_conf.xml'] to /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node2/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_rename_column/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/instant_moves.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/part_log.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/zookeeper_session_timeout.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/storage_configuration.xml'] to /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node2/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/configs/config.d/storage_conf.xml'] to /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node2/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_rename_column/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/instant_moves.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/part_log.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/zookeeper_session_timeout.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/storage_configuration.xml'] to /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node2/configs/config.d Setup directory for instance: node2 Setup directory for instance: node2 Setup database dir /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/node/database Setup database dir /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/node/database Setup logs dir /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/node/logs Setup logs dir /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/node/logs Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node2/database Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node2/database Create directory for configuration generated in this helper Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node2/logs Create directory for configuration generated in this helper Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node2/logs Setup database dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node2/database Setup database dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node2/database Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw'} stored in /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/.env Create directory for common tests configuration Setup logs dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node2/logs Create directory for common tests configuration Setup logs dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node2/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw'} stored in /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/.env Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Copy common configuration from helpers Copy common configuration from helpers Setup directory for instance: node3 Setup directory for instance: node3 Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] No config file found Generate and write macros file Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Setup directory for instance: node3 Setup directory for instance: node3 No config file found No config file found Generate and write macros file Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy custom test config files ['/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/first_client.crt', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/first_client.key', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/second_client.crt', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/second_client.key', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/third_client.crt', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/third_client.key', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/conf.d/remote_servers.xml', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/conf.d/ssl_conf.xml', '/ClickHouse/tests/integration/test_reload_client_certificate/configs/zookeeper_config_with_ssl.xml'] to /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node2/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/first_client.crt', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/first_client.key', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/second_client.crt', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/second_client.key', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/third_client.crt', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/third_client.key', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/conf.d/remote_servers.xml', '/ClickHouse/tests/integration/test_reload_client_certificate/configs_secure/conf.d/ssl_conf.xml', '/ClickHouse/tests/integration/test_reload_client_certificate/configs/zookeeper_config_with_ssl.xml'] to /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node2/configs/config.d Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Generate and write macros file Setup database dir /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node2/database Generate and write macros file Setup database dir /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node2/database Setup logs dir /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node2/logs Setup logs dir /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node2/logs Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/configs/config.d/storage_conf.xml'] to /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node3/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/configs/config.d/storage_conf.xml'] to /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node3/configs/config.d Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Copy custom test config files ['/ClickHouse/tests/integration/test_rename_column/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/instant_moves.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/part_log.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/zookeeper_session_timeout.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/storage_configuration.xml'] to /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node3/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_rename_column/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/instant_moves.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/part_log.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/zookeeper_session_timeout.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/storage_configuration.xml'] to /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node3/configs/config.d Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'ZOO_SECURE_CLIENT_PORT': '2281', 'ZK_FS': 'bind', 'ZK_DATA1': '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/zk1/data', 'ZK_DATA_LOG1': '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/zk1/log', 'ZK_DATA2': '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/zk2/data', 'ZK_DATA_LOG2': '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/zk2/log', 'ZK_DATA3': '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/zk3/data', 'ZK_DATA_LOG3': '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/zk3/log'} stored in /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'ZOO_SECURE_CLIENT_PORT': '2281', 'ZK_FS': 'bind', 'ZK_DATA1': '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/zk1/data', 'ZK_DATA_LOG1': '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/zk1/log', 'ZK_DATA2': '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/zk2/data', 'ZK_DATA_LOG2': '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/zk2/log', 'ZK_DATA3': '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/zk3/data', 'ZK_DATA_LOG3': '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/zk3/log'} stored in /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node3/database Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node3/database Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node3/logs Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node3/logs Setup database dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node3/database Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Setup database dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node3/database Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Setup logs dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node3/logs No config file found Setup logs dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node3/logs No config file found Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/.env No config file found No config file found Setup directory for instance: node4 Setup directory for instance: node4 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Create directory for common tests configuration Create directory for common tests configuration No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Copy common configuration from helpers No config file found Copy common configuration from helpers No config file found Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_rename_column/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/instant_moves.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/part_log.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/zookeeper_session_timeout.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/storage_configuration.xml'] to /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node4/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_rename_column/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/instant_moves.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/part_log.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/zookeeper_session_timeout.xml', '/ClickHouse/tests/integration/test_rename_column/configs/config.d/storage_configuration.xml'] to /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node4/configs/config.d Setup database dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node4/database Setup database dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node4/database Setup logs dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node4/logs Setup logs dir /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node4/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/.env Stdout:1 Stdout:1 Volumes pruned: 1 Volumes pruned: 1 Setup directory for instance: node1 Setup directory for instance: node1 Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Stdout:1 Stdout:1 Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_user_defined_functions/configs/config.xml'] to /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_user_defined_functions/configs/config.xml'] to /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/configs/config.d Volumes pruned: 1 Volumes pruned: 1 http://localhost:None "GET /version HTTP/1.1" 200 826 Setup directory for instance: node Setup directory for instance: node http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/.env --project-name roottests3lowcardinalityrightborder-gw7 --file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/.env --project-name roottests3lowcardinalityrightborder-gw7 --file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Setup database dir /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/database Setup database dir /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/database Create directory for configuration generated in this helper Create directory for configuration generated in this helper Setup logs dir /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/logs Setup logs dir /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/logs http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Create directory for common tests configuration Create directory for common tests configuration Setup directory for instance: node2 Setup directory for instance: node2 Copy common configuration from helpers Copy common configuration from helpers Command:[docker compose --env-file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/.env --project-name roottestrocksdboptions-gw5 --file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/node/docker-compose.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/.env --project-name roottestrocksdboptions-gw5 --file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/node/docker-compose.yml pull] Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Generate and write macros file Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_reload_clusters_config/configs/remote_servers.xml'] to /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/node/configs/config.d Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_reload_clusters_config/configs/remote_servers.xml'] to /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/node/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_user_defined_functions/configs/config.xml'] to /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_user_defined_functions/configs/config.xml'] to /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/configs/config.d Setup database dir /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/database Setup database dir /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/database Setup database dir /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/node/database Setup logs dir /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/logs Setup logs dir /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/logs Setup database dir /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/node/database Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env Setup logs dir /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/node/logs Setup logs dir /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/node/logs http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] http://localhost:None "GET /version HTTP/1.1" 200 826 Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] http://localhost:None "GET /version HTTP/1.1" 200 826 Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/.env No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --project-name roottestreloadclientcertificate-gw9 --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node2/docker-compose.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --project-name roottestreloadclientcertificate-gw9 --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node2/docker-compose.yml pull] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/.env --project-name roottestreplicatedmergetrees3zerocopy-gw6 --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node3/docker-compose.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/.env --project-name roottestreplicatedmergetrees3zerocopy-gw6 --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node3/docker-compose.yml pull] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/.env --project-name roottestrenamecolumn-gw3 --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node3/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node4/docker-compose.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/.env --project-name roottestrenamecolumn-gw3 --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node3/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node4/docker-compose.yml pull] Stdout:1 Stdout:1 Volumes pruned: 1 Volumes pruned: 1 Setup directory for instance: remote_proxy_node Setup directory for instance: remote_proxy_node Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/configs/config.d/proxy_remote.xml'] to /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/configs/config.d/proxy_remote.xml'] to /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/configs/config.d Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/database Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/database Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/logs Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Setup directory for instance: remote_proxy_node_no_proxy Setup directory for instance: remote_proxy_node_no_proxy Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/configs/config.d/proxy_remote_no_proxy.xml'] to /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node_no_proxy/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/configs/config.d/proxy_remote_no_proxy.xml'] to /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node_no_proxy/configs/config.d http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/.env --project-name roottestreloadclustersconfig-gw8 --file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/.env --project-name roottestreloadclustersconfig-gw8 --file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml pull] Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node_no_proxy/database Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node_no_proxy/database Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node_no_proxy/logs Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node_no_proxy/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Setup directory for instance: proxy_list_node Setup directory for instance: proxy_list_node Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/configs/config.d/proxy_list.xml'] to /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/configs/config.d/proxy_list.xml'] to /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node/configs/config.d Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node/database Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node/database Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node/logs Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Setup directory for instance: proxy_list_node_no_proxy Setup directory for instance: proxy_list_node_no_proxy Create directory for configuration generated in this helper Create directory for configuration generated in this helper Stdout:1 Stdout:1 Create directory for common tests configuration Create directory for common tests configuration Volumes pruned: 1 Volumes pruned: 1 Setup directory for instance: instance Setup directory for instance: instance Copy common configuration from helpers Copy common configuration from helpers Create directory for configuration generated in this helper Generate and write macros file Create directory for configuration generated in this helper Generate and write macros file Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy custom test config files ['/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/configs/config.d/proxy_list_no_proxy.xml'] to /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node_no_proxy/configs/config.d Copy common configuration from helpers Copy custom test config files ['/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/configs/config.d/proxy_list_no_proxy.xml'] to /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node_no_proxy/configs/config.d Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node_no_proxy/database Generate and write macros file Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node_no_proxy/database Generate and write macros file Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node_no_proxy/logs Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node_no_proxy/logs Copy custom test config files ['/ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/configs/log_conf.xml'] to /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/instance/configs/config.d Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Copy custom test config files ['/ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/configs/log_conf.xml'] to /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/instance/configs/config.d Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Setup directory for instance: env_node Setup directory for instance: env_node Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files [] to /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node/configs/config.d Copy custom test config files [] to /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node/configs/config.d Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node/database Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node/database Setup database dir /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/instance/database Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node/logs Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node/logs Setup database dir /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/instance/database Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/resolver', 'RESOLVER_LOGS_FS': 'bind', 'http_proxy': 'http://proxy1'} stored in /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/resolver', 'RESOLVER_LOGS_FS': 'bind', 'http_proxy': 'http://proxy1'} stored in /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node/.env Setup logs dir /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/instance/logs Setup directory for instance: env_node_no_proxy Setup directory for instance: env_node_no_proxy Setup logs dir /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/instance/logs Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'POSTGRES_PORT': '5432', 'POSTGRES_DIR': '/ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/postgres/postgres1', 'POSTGRES_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'POSTGRES_PORT': '5432', 'POSTGRES_DIR': '/ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/postgres/postgres1', 'POSTGRES_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/.env Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Copy custom test config files [] to /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node_no_proxy/configs/config.d Copy custom test config files [] to /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node_no_proxy/configs/config.d Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node_no_proxy/database Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node_no_proxy/database Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node_no_proxy/logs Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node_no_proxy/logs No config file found Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] No config file found Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/resolver', 'RESOLVER_LOGS_FS': 'bind', 'http_proxy': 'http://proxy1', 'no_proxy': 'not_important_host,, minio1 ,'} stored in /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node_no_proxy/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/resolver', 'RESOLVER_LOGS_FS': 'bind', 'http_proxy': 'http://proxy1', 'no_proxy': 'not_important_host,, minio1 ,'} stored in /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node_no_proxy/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/.env No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --project-name roottestreplicateduserdefinedfunctions-gw2 --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/docker-compose.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --project-name roottestreplicateduserdefinedfunctions-gw2 --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/docker-compose.yml pull] http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/.env --project-name roottests3tablefunctionwithhttpproxy-gw4 --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node_no_proxy/docker-compose.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/.env --project-name roottests3tablefunctionwithhttpproxy-gw4 --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node_no_proxy/docker-compose.yml pull] http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/.env --project-name roottestpostgresqlreplicadatabaseengine1-gw0 --file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/instance/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_postgres.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/.env --project-name roottestpostgresqlreplicadatabaseengine1-gw0 --file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/instance/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_postgres.yml pull] Stdout:Deleted Networks: Stdout:Deleted Networks: Stdout:roottestmysqlprotocol-gw0_default Stdout:roottestmysqlprotocol-gw0_default Stdout: Stdout: Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Stdout:net.ipv4.ip_local_port_range = 55000 65535 Stdout:net.ipv4.ip_local_port_range = 55000 65535 Running tests in /ClickHouse/tests/integration/test_scheduler/test.py Running tests in /ClickHouse/tests/integration/test_scheduler/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottestscheduler-gw1 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestscheduler-gw1 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestscheduler-gw1 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestscheduler-gw1 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestscheduler-gw1 are DRIVER VOLUME NAME Docker volumes for project roottestscheduler-gw1 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottestscheduler-gw1 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestscheduler-gw1 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestscheduler-gw1 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestscheduler-gw1 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestscheduler-gw1 are DRIVER VOLUME NAME Docker volumes for project roottestscheduler-gw1 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestscheduler-gw1-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestscheduler-gw1-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestscheduler-gw1 No running containers for project: roottestscheduler-gw1 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:1 Stdout:1 Volumes pruned: 1 Volumes pruned: 1 Setup directory for instance: node Setup directory for instance: node Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_scheduler/configs/storage_configuration.xml', '/ClickHouse/tests/integration/test_scheduler/configs/resources.xml', '/ClickHouse/tests/integration/test_scheduler/configs/resources.xml.default', '/ClickHouse/tests/integration/test_scheduler/configs/workloads.xml', '/ClickHouse/tests/integration/test_scheduler/configs/workloads.xml.default'] to /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_scheduler/configs/storage_configuration.xml', '/ClickHouse/tests/integration/test_scheduler/configs/resources.xml', '/ClickHouse/tests/integration/test_scheduler/configs/resources.xml.default', '/ClickHouse/tests/integration/test_scheduler/configs/workloads.xml', '/ClickHouse/tests/integration/test_scheduler/configs/workloads.xml.default'] to /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node/configs/config.d Setup database dir /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node/database Setup database dir /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node/database Setup logs dir /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node/logs Setup logs dir /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node/logs Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Setup directory for instance: node2 Setup directory for instance: node2 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_scheduler/configs/storage_configuration.xml', '/ClickHouse/tests/integration/test_scheduler/configs/resources.xml', '/ClickHouse/tests/integration/test_scheduler/configs/resources.xml.default', '/ClickHouse/tests/integration/test_scheduler/configs/workloads.xml', '/ClickHouse/tests/integration/test_scheduler/configs/workloads.xml.default'] to /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node2/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_scheduler/configs/storage_configuration.xml', '/ClickHouse/tests/integration/test_scheduler/configs/resources.xml', '/ClickHouse/tests/integration/test_scheduler/configs/resources.xml.default', '/ClickHouse/tests/integration/test_scheduler/configs/workloads.xml', '/ClickHouse/tests/integration/test_scheduler/configs/workloads.xml.default'] to /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node2/configs/config.d Setup database dir /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node2/database Setup database dir /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node2/database Setup logs dir /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node2/logs Setup logs dir /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node2/logs Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/.env --project-name roottestscheduler-gw1 --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node2/docker-compose.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/.env --project-name roottestscheduler-gw1 --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node2/docker-compose.yml pull] Stderr: node Skipped - Image is already being pulled by zoo3 Stderr: node Skipped - Image is already being pulled by zoo3 Stderr: zoo1 Skipped - Image is already being pulled by zoo3 Stderr: zoo1 Skipped - Image is already being pulled by zoo3 Stderr: zoo2 Skipped - Image is already being pulled by zoo3 Stderr: zoo2 Skipped - Image is already being pulled by zoo3 Stderr: zoo3 Pulling Stderr: zoo3 Pulling Stderr: zoo3 Pulled Stderr: zoo3 Pulled Setup ZooKeeper Setup ZooKeeper Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper1/log', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper1/config', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper1/coordination', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper2/log', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper2/config', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper2/coordination', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper3/log', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper3/config', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper3/coordination'] Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper1/log', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper1/config', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper1/coordination', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper2/log', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper2/config', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper2/coordination', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper3/log', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper3/config', '/ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/keeper3/coordination'] Command:[docker compose --project-name roottestreloadclustersconfig-gw8 --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Command:[docker compose --project-name roottestreloadclustersconfig-gw8 --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Stderr: node Pulling Stderr: node Pulling Stderr: node Pulled Stderr: node Pulled ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/.env --project-name roottestrocksdboptions-gw5 --file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/node/docker-compose.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/.env --project-name roottestrocksdboptions-gw5 --file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/node/docker-compose.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/.env --project-name roottestrocksdboptions-gw5 --file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/node/docker-compose.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/.env --project-name roottestrocksdboptions-gw5 --file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/node/docker-compose.yml up -d --no-recreate] Stderr: zoo1 Skipped - Image is already being pulled by zoo2 Stderr: zoo1 Skipped - Image is already being pulled by zoo2 Stderr: node2 Skipped - Image is already being pulled by zoo2 Stderr: node2 Skipped - Image is already being pulled by zoo2 Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: node Skipped - Image is already being pulled by zoo2 Stderr: node Skipped - Image is already being pulled by zoo2 Stderr: zoo3 Skipped - Image is already being pulled by zoo2 Stderr: zoo3 Skipped - Image is already being pulled by zoo2 Stderr: zoo2 Pulling Stderr: zoo2 Pulling Stderr: minio1 Pulling Stderr: minio1 Pulling Stderr: resolver Pulling Stderr: resolver Pulling Stderr: proxy1 Pulling Stderr: proxy1 Pulling Stderr: proxy1 Pulled Stderr: proxy1 Pulled Stderr: minio1 Pulled Stderr: minio1 Pulled Stderr: resolver Pulled Stderr: resolver Pulled Stderr: zoo2 Pulled Stderr: zoo2 Pulled Setup ZooKeeper Setup ZooKeeper Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper1/log', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper1/config', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper1/coordination', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper2/log', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper2/config', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper2/coordination', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper3/log', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper3/config', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper3/coordination'] Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper1/log', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper1/config', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper1/coordination', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper2/log', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper2/config', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper2/coordination', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper3/log', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper3/config', '/ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/keeper3/coordination'] Command:[docker compose --project-name roottestscheduler-gw1 --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Command:[docker compose --project-name roottestscheduler-gw1 --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Stderr: zoo2 Skipped - Image is already being pulled by zoo1 Stderr: zoo2 Skipped - Image is already being pulled by zoo1 Stderr: node1 Skipped - Image is already being pulled by node2 Stderr: node1 Skipped - Image is already being pulled by node2 Stderr: zoo3 Skipped - Image is already being pulled by zoo1 Stderr: zoo3 Skipped - Image is already being pulled by zoo1 Stderr: node2 Skipped - Image is already being pulled by zoo1 Stderr: node2 Skipped - Image is already being pulled by zoo1 Stderr: node3 Skipped - Image is already being pulled by zoo1 Stderr: node3 Skipped - Image is already being pulled by zoo1 Stderr: zoo1 Skipped - Image is already being pulled by node2 Stderr: zoo1 Skipped - Image is already being pulled by node2 Stderr: node4 Skipped - Image is already being pulled by zoo1 Stderr: node4 Skipped - Image is already being pulled by zoo1 Stderr: zoo2 Skipped - Image is already being pulled by node2 Stderr: zoo2 Skipped - Image is already being pulled by node2 Stderr: node1 Skipped - Image is already being pulled by zoo1 Stderr: node1 Skipped - Image is already being pulled by zoo1 Stderr: zoo1 Pulling Stderr: zoo1 Pulling Stderr: zoo3 Skipped - Image is already being pulled by node2 Stderr: zoo3 Skipped - Image is already being pulled by node2 Stderr: zoo1 Pulled Stderr: zoo1 Pulled Stderr: node2 Pulling Setup ZooKeeper Setup ZooKeeper Stderr: node2 Pulling Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper1/log', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper1/config', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper1/coordination', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper2/log', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper2/config', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper2/coordination', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper3/log', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper3/config', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper3/coordination'] Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper1/log', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper1/config', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper1/coordination', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper2/log', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper2/config', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper2/coordination', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper3/log', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper3/config', '/ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/keeper3/coordination'] Stderr: node2 Pulled Stderr: node2 Pulled Setup ZooKeeper Setup ZooKeeper Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper1/log', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper1/config', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper1/coordination', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper2/log', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper2/config', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper2/coordination', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper3/log', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper3/config', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper3/coordination'] Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper1/log', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper1/config', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper1/coordination', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper2/log', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper2/config', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper2/coordination', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper3/log', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper3/config', '/ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/keeper3/coordination'] Command:[docker compose --project-name roottestrenamecolumn-gw3 --env-file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Command:[docker compose --project-name roottestrenamecolumn-gw3 --env-file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Stderr: env_node Skipped - Image is already being pulled by proxy_list_node Stderr: env_node Skipped - Image is already being pulled by proxy_list_node Stderr: proxy1 Skipped - Image is already being pulled by proxy2 Stderr: proxy1 Skipped - Image is already being pulled by proxy2 Stderr: remote_proxy_node Skipped - Image is already being pulled by proxy_list_node Stderr: remote_proxy_node Skipped - Image is already being pulled by proxy_list_node Stderr: proxy_list_node_no_proxy Skipped - Image is already being pulled by proxy_list_node Stderr: proxy_list_node_no_proxy Skipped - Image is already being pulled by proxy_list_node Stderr: env_node_no_proxy Skipped - Image is already being pulled by proxy_list_node Stderr: env_node_no_proxy Skipped - Image is already being pulled by proxy_list_node Stderr: remote_proxy_node_no_proxy Skipped - Image is already being pulled by proxy_list_node Stderr: remote_proxy_node_no_proxy Skipped - Image is already being pulled by proxy_list_node Stderr: minio1 Pulling Stderr: minio1 Pulling Stderr: proxy_list_node Pulling Stderr: proxy_list_node Pulling Stderr: proxy2 Pulling Stderr: proxy2 Pulling Stderr: resolver Pulling Stderr: resolver Pulling Stderr: minio1 Pulled Stderr: minio1 Pulled Stderr: proxy_list_node Pulled Stderr: proxy_list_node Pulled Stderr: proxy2 Pulled Stderr: proxy2 Pulled Stderr: resolver Pulled Stderr: resolver Pulled Trying to create Minio instance by command docker compose --project-name roottests3tablefunctionwithhttpproxy-gw4 --env-file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Trying to create Minio instance by command docker compose --project-name roottests3tablefunctionwithhttpproxy-gw4 --env-file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Command:[docker compose --project-name roottests3tablefunctionwithhttpproxy-gw4 --env-file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Command:[docker compose --project-name roottests3tablefunctionwithhttpproxy-gw4 --env-file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Stderr: zoo3 Skipped - Image is already being pulled by zoo2 Stderr: zoo3 Skipped - Image is already being pulled by zoo2 Stderr: zoo2 Pulling Stderr: zoo2 Pulling Stderr: proxy2 Pulling Stderr: proxy2 Pulling Stderr: resolver Pulling Stderr: resolver Pulling Stderr: minio1 Pulling Stderr: minio1 Pulling Stderr: zoo1 Skipped - Image is already being pulled by zoo2 Stderr: zoo1 Skipped - Image is already being pulled by zoo2 Stderr: node2 Skipped - Image is already being pulled by zoo2 Stderr: node2 Skipped - Image is already being pulled by zoo2 Stderr: node1 Skipped - Image is already being pulled by zoo2 Stderr: node1 Skipped - Image is already being pulled by zoo2 Stderr: node3 Skipped - Image is already being pulled by zoo2 Stderr: node3 Skipped - Image is already being pulled by zoo2 Stderr: proxy1 Skipped - Image is already being pulled by proxy2 Stderr: proxy1 Skipped - Image is already being pulled by proxy2 Stderr: resolver Pulled Stderr: resolver Pulled Stderr: minio1 Pulled Stderr: minio1 Pulled Stderr: zoo2 Pulled Stderr: zoo2 Pulled Stderr: proxy2 Pulled Stderr: proxy2 Pulled Setup ZooKeeper Setup ZooKeeper Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper1/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper1/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper1/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper2/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper2/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper2/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper3/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper3/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper3/coordination'] Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper1/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper1/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper1/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper2/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper2/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper2/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper3/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper3/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/keeper3/coordination'] Command:[docker compose --project-name roottestreplicatedmergetrees3zerocopy-gw6 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Command:[docker compose --project-name roottestreplicatedmergetrees3zerocopy-gw6 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: node1 Pulling Stderr: node1 Pulling Stderr: proxy1 Pulling Stderr: proxy1 Pulling Stderr: resolver Pulling Stderr: resolver Pulling Stderr: minio1 Pulling Stderr: minio1 Pulling Stderr: node1 Pulled Stderr: node1 Pulled Stderr: proxy1 Pulled Stderr: proxy1 Pulled Stderr: minio1 Pulled Stderr: minio1 Pulled Stderr: resolver Pulled Stderr: resolver Pulled Trying to create Minio instance by command docker compose --project-name roottests3lowcardinalityrightborder-gw7 --env-file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Trying to create Minio instance by command docker compose --project-name roottests3lowcardinalityrightborder-gw7 --env-file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Command:[docker compose --project-name roottests3lowcardinalityrightborder-gw7 --env-file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Command:[docker compose --project-name roottests3lowcardinalityrightborder-gw7 --env-file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Stderr: node1 Skipped - Image is already being pulled by node2 Stderr: node1 Skipped - Image is already being pulled by node2 Stderr: zoo3 Skipped - Image is already being pulled by zoo2 Stderr: zoo3 Skipped - Image is already being pulled by zoo2 Stderr: zoo1 Skipped - Image is already being pulled by zoo2 Stderr: zoo1 Skipped - Image is already being pulled by zoo2 Stderr: node2 Pulling Stderr: node2 Pulling Stderr: zoo2 Pulling Stderr: zoo2 Pulling Stderr: zoo2 Pulled Stderr: zoo2 Pulled Stderr: node2 Pulled Stderr: node2 Pulled Setup ZooKeeper Secure Setup ZooKeeper Secure Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/zk1/data', '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/zk1/log', '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/zk2/data', '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/zk2/log', '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/zk3/data', '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/zk3/log'] Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/zk1/data', '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/zk1/log', '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/zk2/data', '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/zk2/log', '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/zk3/data', '/ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/zk3/log'] Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml --verbose up -d] Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml --verbose up -d] Stderr: instance Pulling Stderr: instance Pulling Stderr: postgres1 Pulling Stderr: postgres1 Pulling Stderr: postgres1 Pulled Stderr: postgres1 Pulled Stderr: instance Pulled Stderr: instance Pulled Setup Postgres Setup Postgres Command:[docker compose --project-name roottestpostgresqlreplicadatabaseengine1-gw0 --env-file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_postgres.yml --verbose up -d] Command:[docker compose --project-name roottestpostgresqlreplicadatabaseengine1-gw0 --env-file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_postgres.yml --verbose up -d] Stderr:time="2025-04-02T02:53:15Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:53:15Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestreloadclustersconfig-gw8_default Creating Stderr: Network roottestreloadclustersconfig-gw8_default Creating Stderr: Network roottestreloadclustersconfig-gw8_default Created Stderr: Network roottestreloadclustersconfig-gw8_default Created Stderr: Container roottestreloadclustersconfig-gw8-zoo2-1 Creating Stderr: Container roottestreloadclustersconfig-gw8-zoo2-1 Creating Stderr: Container roottestreloadclustersconfig-gw8-zoo1-1 Creating Stderr: Container roottestreloadclustersconfig-gw8-zoo1-1 Creating Stderr: Container roottestreloadclustersconfig-gw8-zoo3-1 Creating Stderr: Container roottestreloadclustersconfig-gw8-zoo3-1 Creating Stderr: Container roottestreloadclustersconfig-gw8-zoo1-1 Created Stderr: Container roottestreloadclustersconfig-gw8-zoo1-1 Created Stderr: Container roottestreloadclustersconfig-gw8-zoo2-1 Created Stderr: Container roottestreloadclustersconfig-gw8-zoo2-1 Created Stderr: Container roottestreloadclustersconfig-gw8-zoo3-1 Created Stderr: Container roottestreloadclustersconfig-gw8-zoo3-1 Created Stderr: Container roottestreloadclustersconfig-gw8-zoo1-1 Starting Stderr: Container roottestreloadclustersconfig-gw8-zoo1-1 Starting Stderr: Container roottestreloadclustersconfig-gw8-zoo2-1 Starting Stderr: Container roottestreloadclustersconfig-gw8-zoo2-1 Starting Stderr: Container roottestreloadclustersconfig-gw8-zoo3-1 Starting Stderr: Container roottestreloadclustersconfig-gw8-zoo3-1 Starting Stderr: Container roottestreloadclustersconfig-gw8-zoo2-1 Started Stderr: Container roottestreloadclustersconfig-gw8-zoo2-1 Started Stderr: Container roottestreloadclustersconfig-gw8-zoo1-1 Started Stderr: Container roottestreloadclustersconfig-gw8-zoo1-1 Started Stderr: Container roottestreloadclustersconfig-gw8-zoo3-1 Started Stderr: Container roottestreloadclustersconfig-gw8-zoo3-1 Started Stderr:time="2025-04-02T02:53:16Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:16Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:16Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:16Z" level=debug msg="otel error" error="" Wait ZooKeeper to start Wait ZooKeeper to start get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreloadclustersconfig-gw8-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclustersconfig-gw8-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.1.4, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.1.4, port:2181, use_ssl:False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Stderr: Network roottestrocksdboptions-gw5_default Creating Stderr: Network roottestrocksdboptions-gw5_default Creating Stderr: Network roottestrocksdboptions-gw5_default Created Stderr: Network roottestrocksdboptions-gw5_default Created Stderr: Container roottestrocksdboptions-gw5-node-1 Creating Stderr: Container roottestrocksdboptions-gw5-node-1 Creating Stderr: Container roottestrocksdboptions-gw5-node-1 Created Stderr: Container roottestrocksdboptions-gw5-node-1 Created Stderr: Container roottestrocksdboptions-gw5-node-1 Starting Stderr: Container roottestrocksdboptions-gw5-node-1 Starting Stderr: Container roottestrocksdboptions-gw5-node-1 Started Stderr: Container roottestrocksdboptions-gw5-node-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottestrocksdboptions-gw5-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrocksdboptions-gw5-node-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottestrocksdboptions-gw5-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrocksdboptions-gw5-node-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node, ip: 172.16.2.2... Waiting for ClickHouse start in node, ip: 172.16.2.2... http://localhost:None "GET /v1.46/containers/roottestrocksdboptions-gw5-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrocksdboptions-gw5-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None Stderr:time="2025-04-02T02:53:15Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:53:15Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestrenamecolumn-gw3_default Creating Stderr: Network roottestrenamecolumn-gw3_default Creating Stderr: Network roottestrenamecolumn-gw3_default Created Stderr: Network roottestrenamecolumn-gw3_default Created Stderr: Container roottestrenamecolumn-gw3-zoo3-1 Creating Stderr: Container roottestrenamecolumn-gw3-zoo3-1 Creating Stderr: Container roottestrenamecolumn-gw3-zoo1-1 Creating Stderr: Container roottestrenamecolumn-gw3-zoo1-1 Creating Stderr: Container roottestrenamecolumn-gw3-zoo2-1 Creating Stderr: Container roottestrenamecolumn-gw3-zoo2-1 Creating Stderr: Container roottestrenamecolumn-gw3-zoo1-1 Created Stderr: Container roottestrenamecolumn-gw3-zoo1-1 Created Stderr: Container roottestrenamecolumn-gw3-zoo3-1 Created Stderr: Container roottestrenamecolumn-gw3-zoo3-1 Created Stderr: Container roottestrenamecolumn-gw3-zoo2-1 Created Stderr: Container roottestrenamecolumn-gw3-zoo2-1 Created Stderr: Container roottestrenamecolumn-gw3-zoo2-1 Starting Stderr: Container roottestrenamecolumn-gw3-zoo2-1 Starting Stderr: Container roottestrenamecolumn-gw3-zoo3-1 Starting Stderr: Container roottestrenamecolumn-gw3-zoo3-1 Starting Stderr: Container roottestrenamecolumn-gw3-zoo1-1 Starting Stderr: Container roottestrenamecolumn-gw3-zoo1-1 Starting Stderr: Container roottestrenamecolumn-gw3-zoo1-1 Started Stderr: Container roottestrenamecolumn-gw3-zoo1-1 Started Stderr: Container roottestrenamecolumn-gw3-zoo2-1 Started Stderr: Container roottestrenamecolumn-gw3-zoo2-1 Started Stderr: Container roottestrenamecolumn-gw3-zoo3-1 Started Stderr: Container roottestrenamecolumn-gw3-zoo3-1 Started Stderr:time="2025-04-02T02:53:16Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:16Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:16Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:16Z" level=debug msg="otel error" error="" Wait ZooKeeper to start Wait ZooKeeper to start get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw3-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw3-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.3.4, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.3.4, port:2181, use_ssl:False Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None Stderr:time="2025-04-02T02:53:15Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:53:15Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestscheduler-gw1_default Creating Stderr: Network roottestscheduler-gw1_default Creating Stderr: Network roottestscheduler-gw1_default Created Stderr: Network roottestscheduler-gw1_default Created Stderr: Container roottestscheduler-gw1-zoo3-1 Creating Stderr: Container roottestscheduler-gw1-zoo3-1 Creating Stderr: Container roottestscheduler-gw1-zoo1-1 Creating Stderr: Container roottestscheduler-gw1-zoo1-1 Creating Stderr: Container roottestscheduler-gw1-zoo2-1 Creating Stderr: Container roottestscheduler-gw1-zoo2-1 Creating Stderr: Container roottestscheduler-gw1-zoo1-1 Created Stderr: Container roottestscheduler-gw1-zoo1-1 Created Stderr: Container roottestscheduler-gw1-zoo2-1 Created Stderr: Container roottestscheduler-gw1-zoo2-1 Created Stderr: Container roottestscheduler-gw1-zoo3-1 Created Stderr: Container roottestscheduler-gw1-zoo3-1 Created Stderr: Container roottestscheduler-gw1-zoo3-1 Starting Stderr: Container roottestscheduler-gw1-zoo3-1 Starting Stderr: Container roottestscheduler-gw1-zoo1-1 Starting Stderr: Container roottestscheduler-gw1-zoo1-1 Starting Stderr: Container roottestscheduler-gw1-zoo2-1 Starting Stderr: Container roottestscheduler-gw1-zoo2-1 Starting Stderr: Container roottestscheduler-gw1-zoo2-1 Started Stderr: Container roottestscheduler-gw1-zoo2-1 Started Stderr: Container roottestscheduler-gw1-zoo3-1 Started Stderr: Container roottestscheduler-gw1-zoo3-1 Started Stderr: Container roottestscheduler-gw1-zoo1-1 Started Stderr: Container roottestscheduler-gw1-zoo1-1 Started Stderr:time="2025-04-02T02:53:17Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:17Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:17Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:17Z" level=debug msg="otel error" error="" Wait ZooKeeper to start Wait ZooKeeper to start get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/roottestscheduler-gw1-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestscheduler-gw1-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.4.3, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.4.3, port:2181, use_ssl:False Connecting to 172.16.4.3(172.16.4.3):2181, use_ssl: False Connecting to 172.16.4.3(172.16.4.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None Connecting to 172.16.4.3(172.16.4.3):2181, use_ssl: False Connecting to 172.16.4.3(172.16.4.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None Stderr:time="2025-04-02T02:53:15Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:53:15Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestreplicateduserdefinedfunctions-gw2_default Creating Stderr: Network roottestreplicateduserdefinedfunctions-gw2_default Creating Stderr: Network roottestreplicateduserdefinedfunctions-gw2_default Created Stderr: Network roottestreplicateduserdefinedfunctions-gw2_default Created Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Creating Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Creating Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Creating Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Creating Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Creating Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Creating Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Created Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Created Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Created Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Created Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Created Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Created Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Started Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Started Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Started Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Started Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Started Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Started Stderr:time="2025-04-02T02:53:17Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:17Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:17Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:17Z" level=debug msg="otel error" error="" Wait ZooKeeper to start Wait ZooKeeper to start get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.5.3, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.5.3, port:2181, use_ssl:False Connecting to 172.16.5.3(172.16.5.3):2181, use_ssl: False Connecting to 172.16.5.3(172.16.5.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.4.3(172.16.4.3):2181, use_ssl: False Connecting to 172.16.4.3(172.16.4.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.5.3(172.16.5.3):2181, use_ssl: False Connecting to 172.16.5.3(172.16.5.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None Connecting to 172.16.5.3(172.16.5.3):2181, use_ssl: False Connecting to 172.16.5.3(172.16.5.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None Connecting to 172.16.4.3(172.16.4.3):2181, use_ssl: False Connecting to 172.16.4.3(172.16.4.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None Connecting to 172.16.5.3(172.16.5.3):2181, use_ssl: False Connecting to 172.16.5.3(172.16.5.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None Stderr:time="2025-04-02T02:53:15Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:53:15Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestreplicatedmergetrees3zerocopy-gw6_default Creating Stderr: Network roottestreplicatedmergetrees3zerocopy-gw6_default Creating Stderr: Network roottestreplicatedmergetrees3zerocopy-gw6_default Created Stderr: Network roottestreplicatedmergetrees3zerocopy-gw6_default Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo1-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo1-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo3-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo3-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo2-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo2-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo1-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo1-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo3-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo3-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo2-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo2-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo1-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo1-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo2-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo2-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo3-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo3-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo2-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo2-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo1-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo1-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo3-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo3-1 Started Stderr:time="2025-04-02T02:53:18Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:18Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:18Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:18Z" level=debug msg="otel error" error="" Wait ZooKeeper to start Wait ZooKeeper to start get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw6-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw6-zoo1-1/json HTTP/1.1" 200 None Stderr:time="2025-04-02T02:53:15Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:53:15Z" level=trace msg="Docker Desktop integration not enabled" get_kazoo_client: zoo1, ip:172.16.7.4, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.7.4, port:2181, use_ssl:False Stderr: Network roottests3tablefunctionwithhttpproxy-gw4_default Creating Stderr: Network roottests3tablefunctionwithhttpproxy-gw4_default Creating Stderr: Network roottests3tablefunctionwithhttpproxy-gw4_default Created Stderr: Network roottests3tablefunctionwithhttpproxy-gw4_default Created Stderr: Volume "roottests3tablefunctionwithhttpproxy-gw4_data1-1" Creating Stderr: Volume "roottests3tablefunctionwithhttpproxy-gw4_data1-1" Creating Stderr: Volume "roottests3tablefunctionwithhttpproxy-gw4_data1-1" Created Stderr: Volume "roottests3tablefunctionwithhttpproxy-gw4_data1-1" Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy2-1 Creating Connecting to 172.16.7.4(172.16.7.4):2181, use_ssl: False Connecting to 172.16.7.4(172.16.7.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy2-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy1-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy1-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy2-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy2-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy1-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy1-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-minio1-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-minio1-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-resolver-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-resolver-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-resolver-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-resolver-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-minio1-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-minio1-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy2-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy2-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy1-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy1-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy1-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy1-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy2-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy2-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-minio1-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-minio1-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-resolver-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-resolver-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-minio1-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-minio1-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-resolver-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-resolver-1 Started Stderr:time="2025-04-02T02:53:18Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:18Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:18Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:18Z" level=debug msg="otel error" error="" Trying to connect to Minio... Trying to connect to Minio... get_instance_ip instance_name=minio1 get_instance_ip instance_name=minio1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-minio1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-minio1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy1 get_instance_ip instance_name=proxy1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Starting new HTTP connection (1): 172.16.6.4:9001 Starting new HTTP connection (1): 172.16.6.4:9001 Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (2): 172.16.6.4:9001 Starting new HTTP connection (2): 172.16.6.4:9001 Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (3): 172.16.6.4:9001 Starting new HTTP connection (3): 172.16.6.4:9001 Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (4): 172.16.6.4:9001 Starting new HTTP connection (4): 172.16.6.4:9001 Can't connect to Minio: HTTPConnectionPool(host='172.16.6.4', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Can't connect to Minio: HTTPConnectionPool(host='172.16.6.4', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.7.4(172.16.7.4):2181, use_ssl: False Connecting to 172.16.7.4(172.16.7.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None Stderr:time="2025-04-02T02:53:16Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:53:16Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestpostgresqlreplicadatabaseengine1-gw0_default Creating Stderr: Network roottestpostgresqlreplicadatabaseengine1-gw0_default Creating Stderr: Network roottestpostgresqlreplicadatabaseengine1-gw0_default Created Stderr: Network roottestpostgresqlreplicadatabaseengine1-gw0_default Created Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-postgres1-1 Creating Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-postgres1-1 Creating Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-postgres1-1 Created Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-postgres1-1 Created Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-postgres1-1 Starting Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-postgres1-1 Starting Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-postgres1-1 Started Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-postgres1-1 Started Stderr:time="2025-04-02T02:53:18Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:18Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:18Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:18Z" level=debug msg="otel error" error="" get_instance_ip instance_name=postgres1 get_instance_ip instance_name=postgres1 http://localhost:None "GET /v1.46/containers/roottestpostgresqlreplicadatabaseengine1-gw0-postgres1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestpostgresqlreplicadatabaseengine1-gw0-postgres1-1/json HTTP/1.1" 200 None Can't connect to Postgres connection to server at "172.16.10.2", port 5432 failed: Connection refused Is the server running on that host and accepting TCP/IP connections? Can't connect to Postgres connection to server at "172.16.10.2", port 5432 failed: Connection refused Is the server running on that host and accepting TCP/IP connections? Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.5.3(172.16.5.3):2181, use_ssl: False Connecting to 172.16.5.3(172.16.5.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None Stderr:time="2025-04-02T02:53:15Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:53:15Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestreloadclientcertificate-gw9_default Creating Stderr: Network roottestreloadclientcertificate-gw9_default Creating Stderr: Network roottestreloadclientcertificate-gw9_default Created Stderr: Network roottestreloadclientcertificate-gw9_default Created Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Creating Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Creating Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Creating Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Creating Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Creating Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Creating Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Created Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Created Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Created Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Created Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Created Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Created Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Started Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Started Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Started Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Started Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Started Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Started Stderr:time="2025-04-02T02:53:18Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:18Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:18Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:18Z" level=debug msg="otel error" error="" Wait ZooKeeper Secure to start Wait ZooKeeper Secure to start get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.9.3, port:2281, use_ssl:True get_kazoo_client: zoo1, ip:172.16.9.3, port:2281, use_ssl:True Connecting to 172.16.9.3(172.16.9.3):2281, use_ssl: True Connecting to 172.16.9.3(172.16.9.3):2281, use_ssl: True Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None Connecting to 172.16.4.3(172.16.4.3):2181, use_ssl: False Connecting to 172.16.4.3(172.16.4.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.7.4(172.16.7.4):2181, use_ssl: False Connecting to 172.16.7.4(172.16.7.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Stderr:time="2025-04-02T02:53:15Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:53:15Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottests3lowcardinalityrightborder-gw7_default Creating Stderr: Network roottests3lowcardinalityrightborder-gw7_default Creating Stderr: Network roottests3lowcardinalityrightborder-gw7_default Created Stderr: Network roottests3lowcardinalityrightborder-gw7_default Created Stderr: Volume "roottests3lowcardinalityrightborder-gw7_data1-1" Creating Stderr: Volume "roottests3lowcardinalityrightborder-gw7_data1-1" Creating Stderr: Volume "roottests3lowcardinalityrightborder-gw7_data1-1" Created Stderr: Volume "roottests3lowcardinalityrightborder-gw7_data1-1" Created Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy1-1 Creating Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy1-1 Creating Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy2-1 Creating Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy2-1 Creating Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy1-1 Created Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy1-1 Created Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy2-1 Created Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy2-1 Created Stderr: Container roottests3lowcardinalityrightborder-gw7-minio1-1 Creating Stderr: Container roottests3lowcardinalityrightborder-gw7-minio1-1 Creating Stderr: Container roottests3lowcardinalityrightborder-gw7-resolver-1 Creating Stderr: Container roottests3lowcardinalityrightborder-gw7-resolver-1 Creating Stderr: Container roottests3lowcardinalityrightborder-gw7-resolver-1 Created Stderr: Container roottests3lowcardinalityrightborder-gw7-resolver-1 Created Stderr: Container roottests3lowcardinalityrightborder-gw7-minio1-1 Created Stderr: Container roottests3lowcardinalityrightborder-gw7-minio1-1 Created Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy1-1 Starting Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy1-1 Starting Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy2-1 Starting Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy2-1 Starting Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy1-1 Started Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy1-1 Started Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy2-1 Started Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy2-1 Started Stderr: Container roottests3lowcardinalityrightborder-gw7-minio1-1 Starting Stderr: Container roottests3lowcardinalityrightborder-gw7-minio1-1 Starting Stderr: Container roottests3lowcardinalityrightborder-gw7-resolver-1 Starting Stderr: Container roottests3lowcardinalityrightborder-gw7-resolver-1 Starting Stderr: Container roottests3lowcardinalityrightborder-gw7-minio1-1 Started Stderr: Container roottests3lowcardinalityrightborder-gw7-minio1-1 Started Stderr: Container roottests3lowcardinalityrightborder-gw7-resolver-1 Started Stderr: Container roottests3lowcardinalityrightborder-gw7-resolver-1 Started Stderr:time="2025-04-02T02:53:18Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:18Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:18Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:18Z" level=debug msg="otel error" error="" Trying to connect to Minio... Trying to connect to Minio... get_instance_ip instance_name=minio1 get_instance_ip instance_name=minio1 http://localhost:None "GET /v1.46/containers/roottests3lowcardinalityrightborder-gw7-minio1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3lowcardinalityrightborder-gw7-minio1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy1 get_instance_ip instance_name=proxy1 Connecting to 172.16.9.3(172.16.9.3):2281, use_ssl: True Connecting to 172.16.9.3(172.16.9.3):2281, use_ssl: True http://localhost:None "GET /v1.46/containers/roottests3lowcardinalityrightborder-gw7-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3lowcardinalityrightborder-gw7-proxy1-1/json HTTP/1.1" 200 None Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Starting new HTTP connection (1): 172.16.8.4:9001 Starting new HTTP connection (1): 172.16.8.4:9001 Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (2): 172.16.8.4:9001 Starting new HTTP connection (2): 172.16.8.4:9001 Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (3): 172.16.8.4:9001 Starting new HTTP connection (3): 172.16.8.4:9001 Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (4): 172.16.8.4:9001 Starting new HTTP connection (4): 172.16.8.4:9001 Can't connect to Minio: HTTPConnectionPool(host='172.16.8.4', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Can't connect to Minio: HTTPConnectionPool(host='172.16.8.4', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/302a052031d76fe62494bcb577f46fce45cfeb4581604d7d3ed29f3cee2a44c2/json HTTP/1.1" 200 None ClickHouse node started ClickHouse node started run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/block_size/no_such_block_based_table_options/g' /etc/clickhouse-server/config.d/rocksdb.xml"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/block_size/no_such_block_based_table_options/g' /etc/clickhouse-server/config.d/rocksdb.xml"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c sed -i 's/block_size/no_such_block_based_table_options/g' /etc/clickhouse-server/config.d/rocksdb.xml] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c sed -i 's/block_size/no_such_block_based_table_options/g' /etc/clickhouse-server/config.d/rocksdb.xml] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c ps -C clickhouse] Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 8 ? 00:00:02 clickhouse Stdout: 8 ? 00:00:02 clickhouse run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c pkill clickhouse] Connecting to 172.16.9.3(172.16.9.3):2281, use_ssl: True Connecting to 172.16.9.3(172.16.9.3):2281, use_ssl: True Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8 Stdout:8 Can't connect to Postgres connection to server at "172.16.10.2", port 5432 failed: Connection refused Is the server running on that host and accepting TCP/IP connections? Can't connect to Postgres connection to server at "172.16.10.2", port 5432 failed: Connection refused Is the server running on that host and accepting TCP/IP connections? Connecting to 172.16.9.3(172.16.9.3):2281, use_ssl: True Connecting to 172.16.9.3(172.16.9.3):2281, use_ssl: True Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.5.3(172.16.5.3):2181, use_ssl: False Connecting to 172.16.5.3(172.16.5.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Starting new HTTP connection (5): 172.16.6.4:9001 Starting new HTTP connection (5): 172.16.6.4:9001 http://172.16.6.4:9001 "GET / HTTP/1.1" 200 0 http://172.16.6.4:9001 "GET / HTTP/1.1" 200 0 Connected to Minio. Connected to Minio. http://172.16.6.4:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.6.4:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.6.4:9001 "PUT /root HTTP/1.1" 200 0 http://172.16.6.4:9001 "PUT /root HTTP/1.1" 200 0 S3 bucket 'root' created S3 bucket 'root' created http://172.16.6.4:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.6.4:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.6.4:9001 "PUT /root2 HTTP/1.1" 200 0 http://172.16.6.4:9001 "PUT /root2 HTTP/1.1" 200 0 S3 bucket 'root2' created S3 bucket 'root2' created ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/.env --project-name roottests3tablefunctionwithhttpproxy-gw4 --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node_no_proxy/docker-compose.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/.env --project-name roottests3tablefunctionwithhttpproxy-gw4 --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node_no_proxy/docker-compose.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/.env --project-name roottests3tablefunctionwithhttpproxy-gw4 --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node_no_proxy/docker-compose.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/.env --project-name roottests3tablefunctionwithhttpproxy-gw4 --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node_no_proxy/docker-compose.yml up -d --no-recreate] Connecting to 172.16.7.4(172.16.7.4):2181, use_ssl: False Connecting to 172.16.7.4(172.16.7.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Can't connect to Postgres connection to server at "172.16.10.2", port 5432 failed: FATAL: the database system is starting up Can't connect to Postgres connection to server at "172.16.10.2", port 5432 failed: FATAL: the database system is starting up Connecting to 172.16.9.3(172.16.9.3):2281, use_ssl: True Connecting to 172.16.9.3(172.16.9.3):2281, use_ssl: True Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Starting new HTTP connection (5): 172.16.8.4:9001 Starting new HTTP connection (5): 172.16.8.4:9001 http://172.16.8.4:9001 "GET / HTTP/1.1" 200 0 http://172.16.8.4:9001 "GET / HTTP/1.1" 200 0 Connected to Minio. Connected to Minio. http://172.16.8.4:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.8.4:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.8.4:9001 "PUT /root HTTP/1.1" 200 0 http://172.16.8.4:9001 "PUT /root HTTP/1.1" 200 0 S3 bucket 'root' created S3 bucket 'root' created http://172.16.8.4:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.8.4:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.8.4:9001 "PUT /root2 HTTP/1.1" 200 0 http://172.16.8.4:9001 "PUT /root2 HTTP/1.1" 200 0 S3 bucket 'root2' created S3 bucket 'root2' created ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/.env --project-name roottests3lowcardinalityrightborder-gw7 --file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/.env --project-name roottests3lowcardinalityrightborder-gw7 --file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/.env --project-name roottests3lowcardinalityrightborder-gw7 --file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/.env --project-name roottests3lowcardinalityrightborder-gw7 --file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Postgres Started Postgres Started ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/.env --project-name roottestpostgresqlreplicadatabaseengine1-gw0 --file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/instance/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_postgres.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/.env --project-name roottestpostgresqlreplicadatabaseengine1-gw0 --file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/instance/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_postgres.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/.env --project-name roottestpostgresqlreplicadatabaseengine1-gw0 --file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/instance/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_postgres.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/.env --project-name roottestpostgresqlreplicadatabaseengine1-gw0 --file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/instance/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_postgres.yml up -d --no-recreate] Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Stdout:8 Stdout:8 Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestreloadclustersconfig-gw8-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclustersconfig-gw8-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.1.2, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.1.2, port:2181, use_ssl:False Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy1-1 Running Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy1-1 Running Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy2-1 Running Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy2-1 Running Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-minio1-1 Running Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-minio1-1 Running Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node_no_proxy-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node_no_proxy-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-resolver-1 Running Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-resolver-1 Running Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node_no_proxy-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node_no_proxy-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node_no_proxy-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node_no_proxy-1 Creating Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node_no_proxy-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node_no_proxy-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node_no_proxy-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node_no_proxy-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node_no_proxy-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node_no_proxy-1 Created Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node_no_proxy-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node_no_proxy-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node_no_proxy-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node_no_proxy-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node_no_proxy-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node_no_proxy-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node-1 Starting Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node_no_proxy-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node_no_proxy-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node_no_proxy-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node_no_proxy-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node_no_proxy-1 Started Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node_no_proxy-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=remote_proxy_node get_instance_ip instance_name=remote_proxy_node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node-1/json HTTP/1.1" 200 None get_instance_ip instance_name=remote_proxy_node get_instance_ip instance_name=remote_proxy_node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in remote_proxy_node, ip: 172.16.6.7... Waiting for ClickHouse start in remote_proxy_node, ip: 172.16.6.7... http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestreloadclustersconfig-gw8-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclustersconfig-gw8-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.1.3, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.1.3, port:2181, use_ssl:False Connecting to 172.16.1.3(172.16.1.3):2181, use_ssl: False Connecting to 172.16.1.3(172.16.1.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None Connecting to 172.16.4.3(172.16.4.3):2181, use_ssl: False Connecting to 172.16.4.3(172.16.4.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.5.3(172.16.5.3):2181, use_ssl: False Connecting to 172.16.5.3(172.16.5.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy2-1 Running Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy2-1 Running Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy1-1 Running Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy1-1 Running Stderr: Container roottests3lowcardinalityrightborder-gw7-resolver-1 Running Stderr: Container roottests3lowcardinalityrightborder-gw7-resolver-1 Running Stderr: Container roottests3lowcardinalityrightborder-gw7-minio1-1 Running Stderr: Container roottests3lowcardinalityrightborder-gw7-minio1-1 Running Stderr: Container roottests3lowcardinalityrightborder-gw7-node1-1 Creating Stderr: Container roottests3lowcardinalityrightborder-gw7-node1-1 Creating Stderr: Container roottests3lowcardinalityrightborder-gw7-node1-1 Created Stderr: Container roottests3lowcardinalityrightborder-gw7-node1-1 Created Stderr: Container roottests3lowcardinalityrightborder-gw7-node1-1 Starting Stderr: Container roottests3lowcardinalityrightborder-gw7-node1-1 Starting Stderr: Container roottests3lowcardinalityrightborder-gw7-node1-1 Started Stderr: Container roottests3lowcardinalityrightborder-gw7-node1-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottests3lowcardinalityrightborder-gw7-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3lowcardinalityrightborder-gw7-node1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottests3lowcardinalityrightborder-gw7-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3lowcardinalityrightborder-gw7-node1-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node1, ip: 172.16.8.6... Waiting for ClickHouse start in node1, ip: 172.16.8.6... http://localhost:None "GET /v1.46/containers/roottests3lowcardinalityrightborder-gw7-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3lowcardinalityrightborder-gw7-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/.env --project-name roottestreloadclustersconfig-gw8 --file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/.env --project-name roottestreloadclustersconfig-gw8 --file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/.env --project-name roottestreloadclustersconfig-gw8 --file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/.env --project-name roottestreloadclustersconfig-gw8 --file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml up -d --no-recreate] http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-postgres1-1 Running Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-postgres1-1 Running Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 Creating Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 Creating Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 Created Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 Created Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 Starting Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 Starting Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 Started Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=instance get_instance_ip instance_name=instance http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestpostgresqlreplicadatabaseengine1-gw0-instance-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestpostgresqlreplicadatabaseengine1-gw0-instance-1/json HTTP/1.1" 200 None get_instance_ip instance_name=instance get_instance_ip instance_name=instance http://localhost:None "GET /v1.46/containers/roottestpostgresqlreplicadatabaseengine1-gw0-instance-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestpostgresqlreplicadatabaseengine1-gw0-instance-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in instance, ip: 172.16.10.3... Waiting for ClickHouse start in instance, ip: 172.16.10.3... http://localhost:None "GET /v1.46/containers/roottestpostgresqlreplicadatabaseengine1-gw0-instance-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestpostgresqlreplicadatabaseengine1-gw0-instance-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None Connecting to 172.16.7.4(172.16.7.4):2181, use_ssl: False Connecting to 172.16.7.4(172.16.7.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None Connecting to 172.16.9.3(172.16.9.3):2281, use_ssl: True Connecting to 172.16.9.3(172.16.9.3):2281, use_ssl: True http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None Stderr: Container roottestreloadclustersconfig-gw8-zoo3-1 Running Stderr: Container roottestreloadclustersconfig-gw8-zoo3-1 Running Stderr: Container roottestreloadclustersconfig-gw8-zoo1-1 Running Stderr: Container roottestreloadclustersconfig-gw8-zoo1-1 Running Stderr: Container roottestreloadclustersconfig-gw8-zoo2-1 Running Stderr: Container roottestreloadclustersconfig-gw8-zoo2-1 Running Stderr: Container roottestreloadclustersconfig-gw8-node-1 Creating Stderr: Container roottestreloadclustersconfig-gw8-node-1 Creating Stderr: Container roottestreloadclustersconfig-gw8-node-1 Created Stderr: Container roottestreloadclustersconfig-gw8-node-1 Created Stderr: Container roottestreloadclustersconfig-gw8-node-1 Starting Stderr: Container roottestreloadclustersconfig-gw8-node-1 Starting Stderr: Container roottestreloadclustersconfig-gw8-node-1 Started Stderr: Container roottestreloadclustersconfig-gw8-node-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottestreloadclustersconfig-gw8-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclustersconfig-gw8-node-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottestreloadclustersconfig-gw8-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclustersconfig-gw8-node-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node, ip: 172.16.1.5... Waiting for ClickHouse start in node, ip: 172.16.1.5... http://localhost:None "GET /v1.46/containers/roottestreloadclustersconfig-gw8-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclustersconfig-gw8-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw5-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw5-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/658c3de41eb9a62cd138d15e66b3033ad528b35c16428c64fbec04775a93d954/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/658c3de41eb9a62cd138d15e66b3033ad528b35c16428c64fbec04775a93d954/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/658c3de41eb9a62cd138d15e66b3033ad528b35c16428c64fbec04775a93d954/json HTTP/1.1" 200 585 http://localhost:None "GET /v1.46/exec/658c3de41eb9a62cd138d15e66b3033ad528b35c16428c64fbec04775a93d954/json HTTP/1.1" 200 585 http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Connection dropped: socket connection broken Connection dropped: socket connection broken http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None Stdout:744 Stdout:744 Clickhouse process running. Clickhouse process running. run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3c2c89b2b9b5b2dd072db1730bbbb2e1c7689752bfe03b8be765ee85713cd225/json HTTP/1.1" 200 None ClickHouse remote_proxy_node started ClickHouse remote_proxy_node started get_instance_ip instance_name=remote_proxy_node_no_proxy get_instance_ip instance_name=remote_proxy_node_no_proxy http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node_no_proxy-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node_no_proxy-1/json HTTP/1.1" 200 None get_instance_ip instance_name=remote_proxy_node_no_proxy get_instance_ip instance_name=remote_proxy_node_no_proxy http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node_no_proxy-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node_no_proxy-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in remote_proxy_node_no_proxy, ip: 172.16.6.10... Waiting for ClickHouse start in remote_proxy_node_no_proxy, ip: 172.16.6.10... http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node_no_proxy-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node_no_proxy-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9cccacc9a698fb441e6c70325c584164e9fcec8266f22730b84f4745f89e2e9e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9cccacc9a698fb441e6c70325c584164e9fcec8266f22730b84f4745f89e2e9e/json HTTP/1.1" 200 None Stdout:744 Stdout:744 Executing query select 20 on node Executing query select 20 on node http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None Connecting to 172.16.7.4(172.16.7.4):2181, use_ssl: False Connecting to 172.16.7.4(172.16.7.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() http://localhost:None "GET /v1.46/containers/9cccacc9a698fb441e6c70325c584164e9fcec8266f22730b84f4745f89e2e9e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9cccacc9a698fb441e6c70325c584164e9fcec8266f22730b84f4745f89e2e9e/json HTTP/1.1" 200 None ClickHouse remote_proxy_node_no_proxy started ClickHouse remote_proxy_node_no_proxy started get_instance_ip instance_name=proxy_list_node get_instance_ip instance_name=proxy_list_node Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy_list_node get_instance_ip instance_name=proxy_list_node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in proxy_list_node, ip: 172.16.6.11... Waiting for ClickHouse start in proxy_list_node, ip: 172.16.6.11... http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c7a83143a526396dc8ac66ad7d6bc69268baa091ec06068ad6c4c3ac3954dd59/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c7a83143a526396dc8ac66ad7d6bc69268baa091ec06068ad6c4c3ac3954dd59/json HTTP/1.1" 200 None ClickHouse proxy_list_node started ClickHouse proxy_list_node started get_instance_ip instance_name=proxy_list_node_no_proxy get_instance_ip instance_name=proxy_list_node_no_proxy http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node_no_proxy-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node_no_proxy-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy_list_node_no_proxy get_instance_ip instance_name=proxy_list_node_no_proxy http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node_no_proxy-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node_no_proxy-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in proxy_list_node_no_proxy, ip: 172.16.6.9... Waiting for ClickHouse start in proxy_list_node_no_proxy, ip: 172.16.6.9... http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node_no_proxy-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node_no_proxy-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/1253eb35acaf2af8e356de4defe27db36dfeba108642124374606e72fd25a60a/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/1253eb35acaf2af8e356de4defe27db36dfeba108642124374606e72fd25a60a/json HTTP/1.1" 200 None ClickHouse proxy_list_node_no_proxy started ClickHouse proxy_list_node_no_proxy started get_instance_ip instance_name=env_node get_instance_ip instance_name=env_node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-env_node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-env_node-1/json HTTP/1.1" 200 None get_instance_ip instance_name=env_node get_instance_ip instance_name=env_node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-env_node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-env_node-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in env_node, ip: 172.16.6.8... Waiting for ClickHouse start in env_node, ip: 172.16.6.8... http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-env_node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-env_node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f0132e70f278199e7092c99614e18d0385ff31beb33b8ae84e3a41a9ff1fd24f/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f0132e70f278199e7092c99614e18d0385ff31beb33b8ae84e3a41a9ff1fd24f/json HTTP/1.1" 200 None ClickHouse env_node started ClickHouse env_node started get_instance_ip instance_name=env_node_no_proxy get_instance_ip instance_name=env_node_no_proxy http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-env_node_no_proxy-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-env_node_no_proxy-1/json HTTP/1.1" 200 None get_instance_ip instance_name=env_node_no_proxy get_instance_ip instance_name=env_node_no_proxy http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-env_node_no_proxy-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-env_node_no_proxy-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in env_node_no_proxy, ip: 172.16.6.6... Waiting for ClickHouse start in env_node_no_proxy, ip: 172.16.6.6... http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-env_node_no_proxy-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-env_node_no_proxy-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8714727d683daf579ceff712b3148208f64c1d6b9fdf3024a6997885f7231c1c/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8714727d683daf579ceff712b3148208f64c1d6b9fdf3024a6997885f7231c1c/json HTTP/1.1" 200 None ClickHouse env_node_no_proxy started ClickHouse env_node_no_proxy started Cluster started Cluster started run container_id:roottests3tablefunctionwithhttpproxy-gw4-resolver-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname resolver.py) && echo aW1wb3J0IHJhbmRvbQoKaW1wb3J0IGJvdHRsZQoKCkBib3R0bGUucm91dGUoIi9ob3N0bmFtZSIpCmRlZiBpbmRleCgpOgogICAgaWYgcmFuZG9tLnJhbmRyYW5nZSgyKSA9PSAwOgogICAgICAgIHJldHVybiAicHJveHkxIgogICAgZWxzZToKICAgICAgICByZXR1cm4gInByb3h5MiIKCgpib3R0bGUucnVuKGhvc3Q9IjAuMC4wLjAiLCBwb3J0PTgwODApCg== | base64 --decode > resolver.py'] run container_id:roottests3tablefunctionwithhttpproxy-gw4-resolver-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname resolver.py) && echo aW1wb3J0IHJhbmRvbQoKaW1wb3J0IGJvdHRsZQoKCkBib3R0bGUucm91dGUoIi9ob3N0bmFtZSIpCmRlZiBpbmRleCgpOgogICAgaWYgcmFuZG9tLnJhbmRyYW5nZSgyKSA9PSAwOgogICAgICAgIHJldHVybiAicHJveHkxIgogICAgZWxzZToKICAgICAgICByZXR1cm4gInByb3h5MiIKCgpib3R0bGUucnVuKGhvc3Q9IjAuMC4wLjAiLCBwb3J0PTgwODApCg== | base64 --decode > resolver.py'] Command:[docker exec roottests3tablefunctionwithhttpproxy-gw4-resolver-1 bash -c mkdir -p $(dirname resolver.py) && echo aW1wb3J0IHJhbmRvbQoKaW1wb3J0IGJvdHRsZQoKCkBib3R0bGUucm91dGUoIi9ob3N0bmFtZSIpCmRlZiBpbmRleCgpOgogICAgaWYgcmFuZG9tLnJhbmRyYW5nZSgyKSA9PSAwOgogICAgICAgIHJldHVybiAicHJveHkxIgogICAgZWxzZToKICAgICAgICByZXR1cm4gInByb3h5MiIKCgpib3R0bGUucnVuKGhvc3Q9IjAuMC4wLjAiLCBwb3J0PTgwODApCg== | base64 --decode > resolver.py] Command:[docker exec roottests3tablefunctionwithhttpproxy-gw4-resolver-1 bash -c mkdir -p $(dirname resolver.py) && echo aW1wb3J0IHJhbmRvbQoKaW1wb3J0IGJvdHRsZQoKCkBib3R0bGUucm91dGUoIi9ob3N0bmFtZSIpCmRlZiBpbmRleCgpOgogICAgaWYgcmFuZG9tLnJhbmRyYW5nZSgyKSA9PSAwOgogICAgICAgIHJldHVybiAicHJveHkxIgogICAgZWxzZToKICAgICAgICByZXR1cm4gInByb3h5MiIKCgpib3R0bGUucnVuKGhvc3Q9IjAuMC4wLjAiLCBwb3J0PTgwODApCg== | base64 --decode > resolver.py] http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None run container_id:roottests3tablefunctionwithhttpproxy-gw4-resolver-1 detach:True nothrow:False cmd: ['python', 'resolver.py'] run container_id:roottests3tablefunctionwithhttpproxy-gw4-resolver-1 detach:True nothrow:False cmd: ['python', 'resolver.py'] Command:[docker exec roottests3tablefunctionwithhttpproxy-gw4-resolver-1 python resolver.py] Command:[docker exec roottests3tablefunctionwithhttpproxy-gw4-resolver-1 python resolver.py] run container_id:roottests3tablefunctionwithhttpproxy-gw4-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/hostname'] run container_id:roottests3tablefunctionwithhttpproxy-gw4-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/hostname'] Command:[docker exec roottests3tablefunctionwithhttpproxy-gw4-resolver-1 curl -s http://resolver:8080/hostname] Command:[docker exec roottests3tablefunctionwithhttpproxy-gw4-resolver-1 curl -s http://resolver:8080/hostname] Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw6-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw6-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.7.3, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.7.3, port:2181, use_ssl:False Connecting to 172.16.7.3(172.16.7.3):2181, use_ssl: False Connecting to 172.16.7.3(172.16.7.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connecting to 172.16.5.3(172.16.5.3):2181, use_ssl: False Connecting to 172.16.5.3(172.16.5.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Exitcode:7 Exitcode:7 run container_id:roottests3tablefunctionwithhttpproxy-gw4-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/hostname'] run container_id:roottests3tablefunctionwithhttpproxy-gw4-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/hostname'] Command:[docker exec roottests3tablefunctionwithhttpproxy-gw4-resolver-1 curl -s http://resolver:8080/hostname] Command:[docker exec roottests3tablefunctionwithhttpproxy-gw4-resolver-1 curl -s http://resolver:8080/hostname] http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None Exitcode:7 Exitcode:7 Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw6-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw6-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.7.2, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.7.2, port:2181, use_ssl:False Connecting to 172.16.7.2(172.16.7.2):2181, use_ssl: False Connecting to 172.16.7.2(172.16.7.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo2-1/json HTTP/1.1" 200 None Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost get_kazoo_client: zoo2, ip:172.16.5.2, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.5.2, port:2181, use_ssl:False Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/01518d1b80336bfa46c08daac01f6ae9703df1528fe1e34dacd9e2e95ce37891/json HTTP/1.1" 200 None ClickHouse node1 started ClickHouse node1 started http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Executing query drop table if exists s3_low_cardinality on node1 Executing query drop table if exists s3_low_cardinality on node1 http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') Trying to create Minio instance by command docker compose --project-name roottestreplicatedmergetrees3zerocopy-gw6 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Trying to create Minio instance by command docker compose --project-name roottestreplicatedmergetrees3zerocopy-gw6 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Command:[docker compose --project-name roottestreplicatedmergetrees3zerocopy-gw6 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Command:[docker compose --project-name roottestreplicatedmergetrees3zerocopy-gw6 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.5.4, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.5.4, port:2181, use_ssl:False Connecting to 172.16.5.4(172.16.5.4):2181, use_ssl: False Connecting to 172.16.5.4(172.16.5.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --project-name roottestreplicateduserdefinedfunctions-gw2 --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/docker-compose.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --project-name roottestreplicateduserdefinedfunctions-gw2 --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/docker-compose.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --project-name roottestreplicateduserdefinedfunctions-gw2 --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/docker-compose.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --project-name roottestreplicateduserdefinedfunctions-gw2 --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/docker-compose.yml up -d --no-recreate] http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None Executing query CREATE TABLE s3_low_cardinality ( str_column LowCardinality(String) ) ENGINE = MergeTree() ORDER BY tuple() SETTINGS storage_policy = 's3', min_bytes_for_wide_part = 0, index_granularity = 1024; on node1 Executing query CREATE TABLE s3_low_cardinality ( str_column LowCardinality(String) ) ENGINE = MergeTree() ORDER BY tuple() SETTINGS storage_policy = 's3', min_bytes_for_wide_part = 0, index_granularity = 1024; on node1 Executing query select 20 on node Executing query select 20 on node http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e6c165c6d9b509d43b5d7b6deeee968fe72138cd4fd12d404dc6370de9ea8522/json HTTP/1.1" 200 None ClickHouse instance started ClickHouse instance started Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query INSERT INTO s3_low_cardinality SELECT 'aaaaaa' FROM numbers(600000) on node1 Executing query INSERT INTO s3_low_cardinality SELECT 'aaaaaa' FROM numbers(600000) on node1 http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw3-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw3-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.3.2, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.3.2, port:2181, use_ssl:False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Running Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Running Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Running Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Running Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Running Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Running Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Creating Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Creating Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Creating Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Creating Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Created Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Created Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Created Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Created Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Started Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Started Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Started Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node1-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node1, ip: 172.16.5.6... Waiting for ClickHouse start in node1, ip: 172.16.5.6... http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None Connecting to 172.16.4.3(172.16.4.3):2181, use_ssl: False Connecting to 172.16.4.3(172.16.4.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw3-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw3-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.3.3, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.3.3, port:2181, use_ssl:False Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/.env --project-name roottestrenamecolumn-gw3 --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node3/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node4/docker-compose.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/.env --project-name roottestrenamecolumn-gw3 --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node3/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node4/docker-compose.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/.env --project-name roottestrenamecolumn-gw3 --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node3/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node4/docker-compose.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/.env --project-name roottestrenamecolumn-gw3 --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node3/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node4/docker-compose.yml up -d --no-recreate] http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestscheduler-gw1-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestscheduler-gw1-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.4.4, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.4.4, port:2181, use_ssl:False Connecting to 172.16.4.4(172.16.4.4):2181, use_ssl: False Connecting to 172.16.4.4(172.16.4.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None run container_id:roottests3tablefunctionwithhttpproxy-gw4-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/hostname'] run container_id:roottests3tablefunctionwithhttpproxy-gw4-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/hostname'] Command:[docker exec roottests3tablefunctionwithhttpproxy-gw4-resolver-1 curl -s http://resolver:8080/hostname] Command:[docker exec roottests3tablefunctionwithhttpproxy-gw4-resolver-1 curl -s http://resolver:8080/hostname] Connecting to 172.16.9.3(172.16.9.3):2281, use_ssl: True Connecting to 172.16.9.3(172.16.9.3):2281, use_ssl: True http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None Stderr:time="2025-04-02T02:53:22Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:53:22Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Volume "roottestreplicatedmergetrees3zerocopy-gw6_data1-1" Creating Stderr: Volume "roottestreplicatedmergetrees3zerocopy-gw6_data1-1" Creating Stderr: Volume "roottestreplicatedmergetrees3zerocopy-gw6_data1-1" Created Stderr: Volume "roottestreplicatedmergetrees3zerocopy-gw6_data1-1" Created Stderr:time="2025-04-02T02:53:22Z" level=warning msg="Found orphan containers ([roottestreplicatedmergetrees3zerocopy-gw6-zoo3-1 roottestreplicatedmergetrees3zerocopy-gw6-zoo2-1 roottestreplicatedmergetrees3zerocopy-gw6-zoo1-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up." Stderr:time="2025-04-02T02:53:22Z" level=warning msg="Found orphan containers ([roottestreplicatedmergetrees3zerocopy-gw6-zoo3-1 roottestreplicatedmergetrees3zerocopy-gw6-zoo2-1 roottestreplicatedmergetrees3zerocopy-gw6-zoo1-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up." Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy2-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy2-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy1-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy1-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy2-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy2-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy1-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy1-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-minio1-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-minio1-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-resolver-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-resolver-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-resolver-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-resolver-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-minio1-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-minio1-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy2-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy2-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy1-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy1-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy2-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy2-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy1-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy1-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-minio1-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-minio1-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-resolver-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-resolver-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-resolver-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-resolver-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-minio1-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-minio1-1 Started Stderr:time="2025-04-02T02:53:23Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:23Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:23Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:23Z" level=debug msg="otel error" error="" Trying to connect to Minio... Trying to connect to Minio... get_instance_ip instance_name=minio1 get_instance_ip instance_name=minio1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw6-minio1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw6-minio1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy1 get_instance_ip instance_name=proxy1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw6-proxy1-1/json HTTP/1.1" 200 None Starting new HTTP connection (1): 172.16.7.7:9001 Starting new HTTP connection (1): 172.16.7.7:9001 Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (2): 172.16.7.7:9001 Starting new HTTP connection (2): 172.16.7.7:9001 Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (3): 172.16.7.7:9001 Starting new HTTP connection (3): 172.16.7.7:9001 Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (4): 172.16.7.7:9001 Starting new HTTP connection (4): 172.16.7.7:9001 Can't connect to Minio: HTTPConnectionPool(host='172.16.7.7', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Can't connect to Minio: HTTPConnectionPool(host='172.16.7.7', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestscheduler-gw1-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestscheduler-gw1-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.4.2, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.4.2, port:2181, use_ssl:False Connecting to 172.16.4.2(172.16.4.2):2181, use_ssl: False Connecting to 172.16.4.2(172.16.4.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Executing query INSERT INTO s3_low_cardinality SELECT toString(number) FROM numbers(100000) on node1 Executing query INSERT INTO s3_low_cardinality SELECT toString(number) FROM numbers(100000) on node1 Executing query select 20 on node Executing query select 20 on node Stdout:proxy1 Stdout:proxy1 Proxy resolver started Proxy resolver started Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/data/env_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV', 'key String, value String') VALUES ('color','red'),('size','10') on env_node_no_proxy Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/data/env_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV', 'key String, value String') VALUES ('color','red'),('size','10') on env_node_no_proxy http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') Trying to create Minio instance by command docker compose --project-name roottestscheduler-gw1 --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Trying to create Minio instance by command docker compose --project-name roottestscheduler-gw1 --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Command:[docker compose --project-name roottestscheduler-gw1 --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Command:[docker compose --project-name roottestscheduler-gw1 --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Received response(xid=1): ['zookeeper'] Received response(xid=1): ['zookeeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Closing connection to 172.16.9.3:2281 Closing connection to 172.16.9.3:2281 Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.9.2, port:2281, use_ssl:True get_kazoo_client: zoo2, ip:172.16.9.2, port:2281, use_ssl:True Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); on node http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None Executing query SELECT * FROM s3('http://minio1:9001/root/data/env_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on env_node_no_proxy Executing query SELECT * FROM s3('http://minio1:9001/root/data/env_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on env_node_no_proxy Stderr: Container roottestrenamecolumn-gw3-zoo1-1 Running Stderr: Container roottestrenamecolumn-gw3-zoo1-1 Running Stderr: Container roottestrenamecolumn-gw3-zoo3-1 Running Stderr: Container roottestrenamecolumn-gw3-zoo3-1 Running Stderr: Container roottestrenamecolumn-gw3-zoo2-1 Running Stderr: Container roottestrenamecolumn-gw3-zoo2-1 Running Stderr: Container roottestrenamecolumn-gw3-node2-1 Creating Stderr: Container roottestrenamecolumn-gw3-node2-1 Creating Stderr: Container roottestrenamecolumn-gw3-node3-1 Creating Stderr: Container roottestrenamecolumn-gw3-node3-1 Creating Stderr: Container roottestrenamecolumn-gw3-node1-1 Creating Stderr: Container roottestrenamecolumn-gw3-node1-1 Creating Stderr: Container roottestrenamecolumn-gw3-node4-1 Creating Stderr: Container roottestrenamecolumn-gw3-node4-1 Creating Stderr: Container roottestrenamecolumn-gw3-node2-1 Created Stderr: Container roottestrenamecolumn-gw3-node2-1 Created Stderr: Container roottestrenamecolumn-gw3-node4-1 Created Stderr: Container roottestrenamecolumn-gw3-node4-1 Created Stderr: Container roottestrenamecolumn-gw3-node3-1 Created Stderr: Container roottestrenamecolumn-gw3-node3-1 Created Stderr: Container roottestrenamecolumn-gw3-node1-1 Created Stderr: Container roottestrenamecolumn-gw3-node1-1 Created Stderr: Container roottestrenamecolumn-gw3-node1-1 Starting Stderr: Container roottestrenamecolumn-gw3-node1-1 Starting Stderr: Container roottestrenamecolumn-gw3-node2-1 Starting Stderr: Container roottestrenamecolumn-gw3-node2-1 Starting Stderr: Container roottestrenamecolumn-gw3-node3-1 Starting Stderr: Container roottestrenamecolumn-gw3-node3-1 Starting Stderr: Container roottestrenamecolumn-gw3-node4-1 Starting Stderr: Container roottestrenamecolumn-gw3-node4-1 Starting Stderr: Container roottestrenamecolumn-gw3-node1-1 Started Stderr: Container roottestrenamecolumn-gw3-node1-1 Started Stderr: Container roottestrenamecolumn-gw3-node3-1 Started Stderr: Container roottestrenamecolumn-gw3-node3-1 Started Stderr: Container roottestrenamecolumn-gw3-node4-1 Started Stderr: Container roottestrenamecolumn-gw3-node4-1 Started Stderr: Container roottestrenamecolumn-gw3-node2-1 Started Stderr: Container roottestrenamecolumn-gw3-node2-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw3-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw3-node1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw3-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw3-node1-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node1, ip: 172.16.3.8... Waiting for ClickHouse start in node1, ip: 172.16.3.8... http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw3-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw3-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['zookeeper'] Received response(xid=1): ['zookeeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Closing connection to 172.16.9.2:2281 Closing connection to 172.16.9.2:2281 Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.9.4, port:2281, use_ssl:True get_kazoo_client: zoo3, ip:172.16.9.4, port:2281, use_ssl:True Connecting to 172.16.9.4(172.16.9.4):2281, use_ssl: True Connecting to 172.16.9.4(172.16.9.4):2281, use_ssl: True http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/no_such_block_based_table_options/block_size/g' /etc/clickhouse-server/config.d/rocksdb.xml"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/no_such_block_based_table_options/block_size/g' /etc/clickhouse-server/config.d/rocksdb.xml"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c sed -i 's/no_such_block_based_table_options/block_size/g' /etc/clickhouse-server/config.d/rocksdb.xml] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c sed -i 's/no_such_block_based_table_options/block_size/g' /etc/clickhouse-server/config.d/rocksdb.xml] http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Starting new HTTP connection (5): 172.16.7.7:9001 Starting new HTTP connection (5): 172.16.7.7:9001 http://172.16.7.7:9001 "GET / HTTP/1.1" 200 0 http://172.16.7.7:9001 "GET / HTTP/1.1" 200 0 Connected to Minio. Connected to Minio. http://172.16.7.7:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.7.7:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.7.7:9001 "PUT /root HTTP/1.1" 200 0 http://172.16.7.7:9001 "PUT /root HTTP/1.1" 200 0 S3 bucket 'root' created S3 bucket 'root' created http://172.16.7.7:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.7.7:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.7.7:9001 "PUT /root2 HTTP/1.1" 200 0 http://172.16.7.7:9001 "PUT /root2 HTTP/1.1" 200 0 S3 bucket 'root2' created S3 bucket 'root2' created ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/.env --project-name roottestreplicatedmergetrees3zerocopy-gw6 --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node3/docker-compose.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/.env --project-name roottestreplicatedmergetrees3zerocopy-gw6 --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node3/docker-compose.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/.env --project-name roottestreplicatedmergetrees3zerocopy-gw6 --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node3/docker-compose.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/.env --project-name roottestreplicatedmergetrees3zerocopy-gw6 --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node3/docker-compose.yml up -d --no-recreate] http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.test_data_types VALUES (0, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance Executing query INSERT INTO postgres_database.test_data_types VALUES (0, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c ps -C clickhouse] Executing query SELECT * FROM s3('http://minio1:9001/root/data/env_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on env_node_no_proxy Executing query SELECT * FROM s3('http://minio1:9001/root/data/env_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on env_node_no_proxy http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 744 ? 00:00:03 clickhouse Stdout: 744 ? 00:00:03 clickhouse run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c pkill clickhouse] http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None Executing query INSERT INTO s3_low_cardinality SELECT 'bbbbbb' FROM numbers(500000) on node1 Executing query INSERT INTO s3_low_cardinality SELECT 'bbbbbb' FROM numbers(500000) on node1 http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None Stdout:744 Stdout:744 http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Stderr:time="2025-04-02T02:53:23Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:53:23Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Volume "roottestscheduler-gw1_data1-1" Creating Stderr: Volume "roottestscheduler-gw1_data1-1" Creating Stderr: Volume "roottestscheduler-gw1_data1-1" Created Stderr: Volume "roottestscheduler-gw1_data1-1" Created Stderr:time="2025-04-02T02:53:23Z" level=warning msg="Found orphan containers ([roottestscheduler-gw1-zoo1-1 roottestscheduler-gw1-zoo2-1 roottestscheduler-gw1-zoo3-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up." Stderr:time="2025-04-02T02:53:23Z" level=warning msg="Found orphan containers ([roottestscheduler-gw1-zoo1-1 roottestscheduler-gw1-zoo2-1 roottestscheduler-gw1-zoo3-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up." Stderr: Container roottestscheduler-gw1-proxy1-1 Creating Stderr: Container roottestscheduler-gw1-proxy1-1 Creating Stderr: Container roottestscheduler-gw1-proxy2-1 Creating Stderr: Container roottestscheduler-gw1-proxy2-1 Creating Stderr: Container roottestscheduler-gw1-proxy2-1 Created Stderr: Container roottestscheduler-gw1-proxy2-1 Created Stderr: Container roottestscheduler-gw1-proxy1-1 Created Stderr: Container roottestscheduler-gw1-proxy1-1 Created Stderr: Container roottestscheduler-gw1-minio1-1 Creating Stderr: Container roottestscheduler-gw1-minio1-1 Creating Stderr: Container roottestscheduler-gw1-resolver-1 Creating Stderr: Container roottestscheduler-gw1-resolver-1 Creating Stderr: Container roottestscheduler-gw1-resolver-1 Created Stderr: Container roottestscheduler-gw1-resolver-1 Created Stderr: Container roottestscheduler-gw1-minio1-1 Created Stderr: Container roottestscheduler-gw1-minio1-1 Created Stderr: Container roottestscheduler-gw1-proxy2-1 Starting Stderr: Container roottestscheduler-gw1-proxy2-1 Starting Stderr: Container roottestscheduler-gw1-proxy1-1 Starting Stderr: Container roottestscheduler-gw1-proxy1-1 Starting Stderr: Container roottestscheduler-gw1-proxy2-1 Started Stderr: Container roottestscheduler-gw1-proxy2-1 Started Stderr: Container roottestscheduler-gw1-proxy1-1 Started Stderr: Container roottestscheduler-gw1-proxy1-1 Started Stderr: Container roottestscheduler-gw1-resolver-1 Starting Stderr: Container roottestscheduler-gw1-resolver-1 Starting Stderr: Container roottestscheduler-gw1-minio1-1 Starting Stderr: Container roottestscheduler-gw1-minio1-1 Starting Stderr: Container roottestscheduler-gw1-resolver-1 Started Stderr: Container roottestscheduler-gw1-resolver-1 Started Stderr: Container roottestscheduler-gw1-minio1-1 Started Stderr: Container roottestscheduler-gw1-minio1-1 Started Stderr:time="2025-04-02T02:53:24Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:24Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:24Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:53:24Z" level=debug msg="otel error" error="" Trying to connect to Minio... Trying to connect to Minio... get_instance_ip instance_name=minio1 get_instance_ip instance_name=minio1 http://localhost:None "GET /v1.46/containers/roottestscheduler-gw1-minio1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestscheduler-gw1-minio1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy1 get_instance_ip instance_name=proxy1 http://localhost:None "GET /v1.46/containers/roottestscheduler-gw1-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestscheduler-gw1-proxy1-1/json HTTP/1.1" 200 None Starting new HTTP connection (1): 172.16.4.8:9001 Starting new HTTP connection (1): 172.16.4.8:9001 Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (2): 172.16.4.8:9001 Starting new HTTP connection (2): 172.16.4.8:9001 http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (3): 172.16.4.8:9001 Starting new HTTP connection (3): 172.16.4.8:9001 Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (4): 172.16.4.8:9001 Starting new HTTP connection (4): 172.16.4.8:9001 http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None Can't connect to Minio: HTTPConnectionPool(host='172.16.4.8', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Can't connect to Minio: HTTPConnectionPool(host='172.16.4.8', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.test_data_types VALUES (1, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance Executing query INSERT INTO postgres_database.test_data_types VALUES (1, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['zookeeper'] Received response(xid=1): ['zookeeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Closing connection to 172.16.9.4:2281 Closing connection to 172.16.9.4:2281 Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --project-name roottestreloadclientcertificate-gw9 --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node2/docker-compose.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --project-name roottestreloadclientcertificate-gw9 --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node2/docker-compose.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --project-name roottestreloadclientcertificate-gw9 --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node2/docker-compose.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --project-name roottestreloadclientcertificate-gw9 --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node2/docker-compose.yml up -d --no-recreate] http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None Executing query INSERT INTO s3_low_cardinality SELECT toString(number + 100000000) FROM numbers(100000) on node1 Executing query INSERT INTO s3_low_cardinality SELECT toString(number + 100000000) FROM numbers(100000) on node1 http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo3-1 Running Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo3-1 Running Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy2-1 Running Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy2-1 Running Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo1-1 Running Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo1-1 Running Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo2-1 Running Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo2-1 Running Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy1-1 Running Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy1-1 Running Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-minio1-1 Running Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-minio1-1 Running http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node2-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node2-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node1-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node1-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node3-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node3-1 Creating Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-resolver-1 Running Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-resolver-1 Running Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node2-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node2-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node3-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node3-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node1-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node1-1 Created Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node1-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node1-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node3-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node3-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node2-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node2-1 Starting Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node2-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node2-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node3-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node3-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node1-1 Started Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node1-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw6-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw6-node1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw6-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw6-node1-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node1, ip: 172.16.7.11... Waiting for ClickHouse start in node1, ip: 172.16.7.11... http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw6-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw6-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.test_data_types VALUES (2, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance Executing query INSERT INTO postgres_database.test_data_types VALUES (2, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Running Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Running Stderr: Container roottestreloadclientcertificate-gw9-node2-1 Creating Stderr: Container roottestreloadclientcertificate-gw9-node2-1 Creating Stderr: Container roottestreloadclientcertificate-gw9-node1-1 Creating Stderr: Container roottestreloadclientcertificate-gw9-node1-1 Creating Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Running Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Running Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Running Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Running Stderr: Container roottestreloadclientcertificate-gw9-node2-1 Created Stderr: Container roottestreloadclientcertificate-gw9-node2-1 Created Stderr: Container roottestreloadclientcertificate-gw9-node1-1 Created Stderr: Container roottestreloadclientcertificate-gw9-node1-1 Created Stderr: Container roottestreloadclientcertificate-gw9-node2-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-node2-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-node1-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-node1-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-node2-1 Started Stderr: Container roottestreloadclientcertificate-gw9-node2-1 Started Stderr: Container roottestreloadclientcertificate-gw9-node1-1 Started Stderr: Container roottestreloadclientcertificate-gw9-node1-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-node1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-node1-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node1, ip: 172.16.9.6... Waiting for ClickHouse start in node1, ip: 172.16.9.6... http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.test_data_types VALUES (3, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance Executing query INSERT INTO postgres_database.test_data_types VALUES (3, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance Executing query OPTIMIZE TABLE s3_low_cardinality FINAL on node1 Executing query OPTIMIZE TABLE s3_low_cardinality FINAL on node1 http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4683080316f62c1cdfda576276e8feb40dd06c05603f64ba4223a4c9286cef94/json HTTP/1.1" 200 None ClickHouse node1 started ClickHouse node1 started get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node2-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node2-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node2, ip: 172.16.5.5... Waiting for ClickHouse start in node2, ip: 172.16.5.5... http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/419262fa60cddad289b5f9d94f7718b039d6066fee07556a34a31b60d25233b1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/419262fa60cddad289b5f9d94f7718b039d6066fee07556a34a31b60d25233b1/json HTTP/1.1" 200 None ClickHouse node2 started ClickHouse node2 started Executing query CREATE FUNCTION f1 AS (x, y) -> x + y on node1 Executing query CREATE FUNCTION f1 AS (x, y) -> x + y on node1 http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None Starting new HTTP connection (5): 172.16.4.8:9001 Starting new HTTP connection (5): 172.16.4.8:9001 http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Stdout:744 Stdout:744 http://172.16.4.8:9001 "GET / HTTP/1.1" 200 0 http://172.16.4.8:9001 "GET / HTTP/1.1" 200 0 Connected to Minio. Connected to Minio. http://172.16.4.8:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.4.8:9001 "GET /root?location= HTTP/1.1" 404 0 http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://172.16.4.8:9001 "PUT /root HTTP/1.1" 200 0 http://172.16.4.8:9001 "PUT /root HTTP/1.1" 200 0 S3 bucket 'root' created S3 bucket 'root' created http://172.16.4.8:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.4.8:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.4.8:9001 "PUT /root2 HTTP/1.1" 200 0 http://172.16.4.8:9001 "PUT /root2 HTTP/1.1" 200 0 S3 bucket 'root2' created S3 bucket 'root2' created ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/.env --project-name roottestscheduler-gw1 --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node2/docker-compose.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/.env --project-name roottestscheduler-gw1 --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node2/docker-compose.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/.env --project-name roottestscheduler-gw1 --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node2/docker-compose.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/.env --project-name roottestscheduler-gw1 --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node2/docker-compose.yml up -d --no-recreate] http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.test_data_types VALUES (4, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance Executing query INSERT INTO postgres_database.test_data_types VALUES (4, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Executing query SELECT f1(12, 3) on node1 Executing query SELECT f1(12, 3) on node1 http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.test_data_types VALUES (5, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance Executing query INSERT INTO postgres_database.test_data_types VALUES (5, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None Executing query DROP FUNCTION f1 on node1 Executing query DROP FUNCTION f1 on node1 http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/a8b61b2d00c2a7e81871d63e87609f76f89865cdb4169a60b8047f8c340856b8/json HTTP/1.1" 200 None ClickHouse node1 started ClickHouse node1 started get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw3-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw3-node2-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw3-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw3-node2-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node2, ip: 172.16.3.6... Waiting for ClickHouse start in node2, ip: 172.16.3.6... http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw3-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw3-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4ca8e0871401b2b5b7f9ff785e7840b0c9ec84f540c1150d11f4c5ad26d233ff/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4ca8e0871401b2b5b7f9ff785e7840b0c9ec84f540c1150d11f4c5ad26d233ff/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None Stderr: Container roottestscheduler-gw1-proxy1-1 Running Stderr: Container roottestscheduler-gw1-proxy1-1 Running Stderr: Container roottestscheduler-gw1-zoo3-1 Running Stderr: Container roottestscheduler-gw1-zoo3-1 Running Stderr: Container roottestscheduler-gw1-zoo1-1 Running Stderr: Container roottestscheduler-gw1-zoo1-1 Running Stderr: Container roottestscheduler-gw1-proxy2-1 Running Stderr: Container roottestscheduler-gw1-proxy2-1 Running Stderr: Container roottestscheduler-gw1-minio1-1 Running Stderr: Container roottestscheduler-gw1-minio1-1 Running Stderr: Container roottestscheduler-gw1-zoo2-1 Running Stderr: Container roottestscheduler-gw1-zoo2-1 Running Stderr: Container roottestscheduler-gw1-node2-1 Creating Stderr: Container roottestscheduler-gw1-node2-1 Creating Stderr: Container roottestscheduler-gw1-resolver-1 Running Stderr: Container roottestscheduler-gw1-resolver-1 Running Stderr: Container roottestscheduler-gw1-node-1 Creating Stderr: Container roottestscheduler-gw1-node-1 Creating Stderr: Container roottestscheduler-gw1-node-1 Created Stderr: Container roottestscheduler-gw1-node-1 Created Stderr: Container roottestscheduler-gw1-node2-1 Created Stderr: Container roottestscheduler-gw1-node2-1 Created Stderr: Container roottestscheduler-gw1-node-1 Starting Stderr: Container roottestscheduler-gw1-node-1 Starting Stderr: Container roottestscheduler-gw1-node2-1 Starting Stderr: Container roottestscheduler-gw1-node2-1 Starting Stderr: Container roottestscheduler-gw1-node-1 Started Stderr: Container roottestscheduler-gw1-node-1 Started Stderr: Container roottestscheduler-gw1-node2-1 Started Stderr: Container roottestscheduler-gw1-node2-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottestscheduler-gw1-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestscheduler-gw1-node-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottestscheduler-gw1-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestscheduler-gw1-node-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node, ip: 172.16.4.9... Waiting for ClickHouse start in node, ip: 172.16.4.9... http://localhost:None "GET /v1.46/containers/roottestscheduler-gw1-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestscheduler-gw1-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4ca8e0871401b2b5b7f9ff785e7840b0c9ec84f540c1150d11f4c5ad26d233ff/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/4ca8e0871401b2b5b7f9ff785e7840b0c9ec84f540c1150d11f4c5ad26d233ff/json HTTP/1.1" 200 None ClickHouse node2 started ClickHouse node2 started get_instance_ip instance_name=node3 get_instance_ip instance_name=node3 http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw3-node3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw3-node3-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node3 get_instance_ip instance_name=node3 http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw3-node3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw3-node3-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node3, ip: 172.16.3.5... Waiting for ClickHouse start in node3, ip: 172.16.3.5... http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw3-node3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw3-node3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/cab25cf37bf10e208159be22abeab942cb64498cec51d5d859e4163e0187264c/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/cab25cf37bf10e208159be22abeab942cb64498cec51d5d859e4163e0187264c/json HTTP/1.1" 200 None [gw2] PASSED test_replicated_user_defined_functions/test.py::test_create_and_drop ClickHouse node3 started ClickHouse node3 started get_instance_ip instance_name=node4 get_instance_ip instance_name=node4 run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "echo '\n \n \n false\n \n \n' > /etc/clickhouse-server/users.d/users.xml"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "echo '\n \n \n false\n \n \n' > /etc/clickhouse-server/users.d/users.xml"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c echo ' false ' > /etc/clickhouse-server/users.d/users.xml] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c echo ' false ' > /etc/clickhouse-server/users.d/users.xml] http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw3-node4-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw3-node4-1/json HTTP/1.1" 200 None test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1] http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None get_instance_ip instance_name=node4 get_instance_ip instance_name=node4 http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw3-node4-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw3-node4-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node4, ip: 172.16.3.7... Waiting for ClickHouse start in node4, ip: 172.16.3.7... http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw3-node4-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrenamecolumn-gw3-node4-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/52d87b9a51642cb3d45376d130fb9b11403e5d14c07205c42b199a98c06d1e49/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/52d87b9a51642cb3d45376d130fb9b11403e5d14c07205c42b199a98c06d1e49/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None Executing query SYSTEM RELOAD CONFIG on node1 Executing query SYSTEM RELOAD CONFIG on node1 Executing query INSERT INTO postgres_database.test_data_types VALUES (6, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance Executing query INSERT INTO postgres_database.test_data_types VALUES (6, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/52d87b9a51642cb3d45376d130fb9b11403e5d14c07205c42b199a98c06d1e49/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/52d87b9a51642cb3d45376d130fb9b11403e5d14c07205c42b199a98c06d1e49/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/52d87b9a51642cb3d45376d130fb9b11403e5d14c07205c42b199a98c06d1e49/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/52d87b9a51642cb3d45376d130fb9b11403e5d14c07205c42b199a98c06d1e49/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/52d87b9a51642cb3d45376d130fb9b11403e5d14c07205c42b199a98c06d1e49/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/52d87b9a51642cb3d45376d130fb9b11403e5d14c07205c42b199a98c06d1e49/json HTTP/1.1" 200 None ClickHouse node4 started ClickHouse node4 started Executing query CREATE TABLE test_rename_distributed_replicated ON CLUSTER test_cluster ( num UInt32, num2 UInt32 DEFAULT num + 1 ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/test/{shard}/test_rename_distributed_replicated', '{replica}') ORDER BY num PARTITION BY num % 100; on node1 Executing query INSERT INTO postgres_database.test_data_types VALUES (7, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance Executing query INSERT INTO postgres_database.test_data_types VALUES (7, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance Executing query CREATE TABLE test_rename_distributed_replicated ON CLUSTER test_cluster ( num UInt32, num2 UInt32 DEFAULT num + 1 ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/test/{shard}/test_rename_distributed_replicated', '{replica}') ORDER BY num PARTITION BY num % 100; on node1 http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None Stdout:744 Stdout:744 Executing query SELECT COUNT() FROM s3_low_cardinality WHERE not ignore(str_column) on node1 Executing query SELECT COUNT() FROM s3_low_cardinality WHERE not ignore(str_column) on node1 Executing query CREATE FUNCTION f1 ON CLUSTER default AS (x, y) -> x + y on node1 Executing query CREATE FUNCTION f1 ON CLUSTER default AS (x, y) -> x + y on node1 http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.test_data_types VALUES (8, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance Executing query INSERT INTO postgres_database.test_data_types VALUES (8, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None [gw2] PASSED test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "echo '\n \n \n true\n \n \n' > /etc/clickhouse-server/users.d/users.xml"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "echo '\n \n \n true\n \n \n' > /etc/clickhouse-server/users.d/users.xml"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c echo ' true ' > /etc/clickhouse-server/users.d/users.xml] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c echo ' true ' > /etc/clickhouse-server/users.d/users.xml] test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0] http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Executing query SYSTEM RELOAD CONFIG on node1 Executing query SYSTEM RELOAD CONFIG on node1 http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None Executing query CREATE TABLE test_rename_distributed ON CLUSTER test_cluster AS test_rename_distributed_replicated ENGINE = Distributed(test_cluster, default, test_rename_distributed_replicated, rand()) on node1 Executing query CREATE TABLE test_rename_distributed ON CLUSTER test_cluster AS test_rename_distributed_replicated ENGINE = Distributed(test_cluster, default, test_rename_distributed_replicated, rand()) on node1 http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.test_data_types VALUES (9, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance Executing query INSERT INTO postgres_database.test_data_types VALUES (9, -32768, -2147483648, -9223372036854775808, 1.12345, 1.1234567890, 2147483647, 9223372036854775807, '2000-05-12 12:12:12.012345', '2000-05-12', 0.2, 0.2) on instance http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None [gw7] PASSED test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None Executing query drop table if exists s3_low_cardinality on node1 Executing query drop table if exists s3_low_cardinality on node1 http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Executing query CREATE FUNCTION f1 ON CLUSTER default AS (x, y) -> x + y on node1 Executing query CREATE FUNCTION f1 ON CLUSTER default AS (x, y) -> x + y on node1 http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/6b401ec2e64ad783354e0547aa8d08abb83402ab9959b0dd34a15bfb59ed64bc/json HTTP/1.1" 200 None ClickHouse node1 started ClickHouse node1 started get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw6-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw6-node2-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw6-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw6-node2-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node2, ip: 172.16.7.10... Waiting for ClickHouse start in node2, ip: 172.16.7.10... http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw6-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw6-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/1646b062a292f420f4ab128e0c3cc2e2a1887c9a2870ab3b2fb29b4b2fd3233b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/1646b062a292f420f4ab128e0c3cc2e2a1887c9a2870ab3b2fb29b4b2fd3233b/json HTTP/1.1" 200 None ClickHouse node2 started ClickHouse node2 started get_instance_ip instance_name=node3 get_instance_ip instance_name=node3 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw6-node3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw6-node3-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node3 get_instance_ip instance_name=node3 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw6-node3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw6-node3-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node3, ip: 172.16.7.9... Waiting for ClickHouse start in node3, ip: 172.16.7.9... http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw6-node3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetrees3zerocopy-gw6-node3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f8e20f56c16e4ae4e5bc15cd38d0f2b8d151aae433c97e3db9c1201f8be3934b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f8e20f56c16e4ae4e5bc15cd38d0f2b8d151aae433c97e3db9c1201f8be3934b/json HTTP/1.1" 200 None ClickHouse node3 started ClickHouse node3 started Cluster started Cluster started run container_id:roottestreplicatedmergetrees3zerocopy-gw6-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicatedmergetrees3zerocopy-gw6-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicatedmergetrees3zerocopy-gw6-node1-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicatedmergetrees3zerocopy-gw6-node1-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query SELECT * FROM `test_database`.`test_data_types` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`test_data_types` LIMIT 1 FORMAT Null on instance http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d4f811637ad55bfe42d6adc5e76faaf80e2b54a7352d3c8382cb7d7d5e38769e/json HTTP/1.1" 200 None ClickHouse node1 started ClickHouse node1 started get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-node2-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node2, ip: 172.16.9.5... Waiting for ClickHouse start in node2, ip: 172.16.9.5... http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-node2-1/json HTTP/1.1" 200 None Stdout:1 Stdout:1 run container_id:roottestreplicatedmergetrees3zerocopy-gw6-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'kill -HUP 1'] run container_id:roottestreplicatedmergetrees3zerocopy-gw6-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'kill -HUP 1'] Command:[docker exec -u root roottestreplicatedmergetrees3zerocopy-gw6-node1-1 bash -c kill -HUP 1] Command:[docker exec -u root roottestreplicatedmergetrees3zerocopy-gw6-node1-1 bash -c kill -HUP 1] http://localhost:None "GET /v1.46/containers/8aff4f12bc86b6d10b2fc12a1bdde3414cf59ef23eaa06ab794c1828ccd6b586/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8aff4f12bc86b6d10b2fc12a1bdde3414cf59ef23eaa06ab794c1828ccd6b586/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None Executing query SELECT f1(12, 3) on node1 Executing query SELECT f1(12, 3) on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(1000) on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(1000) on node1 run container_id:roottestreplicatedmergetrees3zerocopy-gw6-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicatedmergetrees3zerocopy-gw6-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicatedmergetrees3zerocopy-gw6-node2-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicatedmergetrees3zerocopy-gw6-node2-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query create table s3_low_cardinality (key UInt32, str_column LowCardinality(String)) engine = MergeTree order by (key) settings storage_policy = 's3', min_bytes_for_wide_part = 0, index_granularity = 8192, min_compress_block_size=1, merge_max_block_size=10000 on node1 Executing query create table s3_low_cardinality (key UInt32, str_column LowCardinality(String)) engine = MergeTree order by (key) settings storage_policy = 's3', min_bytes_for_wide_part = 0, index_granularity = 8192, min_compress_block_size=1, merge_max_block_size=10000 on node1 http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8aff4f12bc86b6d10b2fc12a1bdde3414cf59ef23eaa06ab794c1828ccd6b586/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8aff4f12bc86b6d10b2fc12a1bdde3414cf59ef23eaa06ab794c1828ccd6b586/json HTTP/1.1" 200 None ClickHouse node2 started ClickHouse node2 started run container_id:roottestreloadclientcertificate-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/second_client.crt\n /etc/clickhouse-server/config.d/second_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] run container_id:roottestreloadclientcertificate-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/second_client.crt\n /etc/clickhouse-server/config.d/second_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] Command:[docker exec roottestreloadclientcertificate-gw9-node1-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/second_client.crt /etc/clickhouse-server/config.d/second_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] Command:[docker exec roottestreloadclientcertificate-gw9-node1-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/second_client.crt /etc/clickhouse-server/config.d/second_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] Stdout:1 Stdout:1 run container_id:roottestreplicatedmergetrees3zerocopy-gw6-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'kill -HUP 1'] run container_id:roottestreplicatedmergetrees3zerocopy-gw6-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'kill -HUP 1'] Command:[docker exec -u root roottestreplicatedmergetrees3zerocopy-gw6-node2-1 bash -c kill -HUP 1] Command:[docker exec -u root roottestreplicatedmergetrees3zerocopy-gw6-node2-1 bash -c kill -HUP 1] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None Executing query select name from system.zookeeper where path='/test/drop_table/replicas' on node1 Executing query select name from system.zookeeper where path='/test/drop_table/replicas' on node1 run container_id:roottestreloadclientcertificate-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] run container_id:roottestreloadclientcertificate-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] Command:[docker exec roottestreloadclientcertificate-gw9-node1-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] Command:[docker exec roottestreloadclientcertificate-gw9-node1-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_data_types' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_data_types' on instance http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw5-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw5-node-1/exec HTTP/1.1" 201 74 run container_id:roottestreloadclientcertificate-gw9-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/second_client.crt\n /etc/clickhouse-server/config.d/second_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] run container_id:roottestreloadclientcertificate-gw9-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/second_client.crt\n /etc/clickhouse-server/config.d/second_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] Command:[docker exec roottestreloadclientcertificate-gw9-node2-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/second_client.crt /etc/clickhouse-server/config.d/second_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] Command:[docker exec roottestreloadclientcertificate-gw9-node2-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/second_client.crt /etc/clickhouse-server/config.d/second_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] http://localhost:None "POST /v1.46/exec/3734043e374fb8329ca660d0edc99b7596df7f5ba9e76186b7c92ef3395ce4fa/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/3734043e374fb8329ca660d0edc99b7596df7f5ba9e76186b7c92ef3395ce4fa/start HTTP/1.1" 200 0 Executing query DROP FUNCTION f1 ON CLUSTER default on node1 Executing query DROP FUNCTION f1 ON CLUSTER default on node1 http://localhost:None "GET /v1.46/exec/3734043e374fb8329ca660d0edc99b7596df7f5ba9e76186b7c92ef3395ce4fa/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/3734043e374fb8329ca660d0edc99b7596df7f5ba9e76186b7c92ef3395ce4fa/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None run container_id:roottestreloadclientcertificate-gw9-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] run container_id:roottestreloadclientcertificate-gw9-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] Command:[docker exec roottestreloadclientcertificate-gw9-node2-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] Command:[docker exec roottestreloadclientcertificate-gw9-node2-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None Stopping zookeeper node: zoo1 Stopping zookeeper node: zoo1 Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo1] Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo1] Executing query insert into s3_low_cardinality select number, number % 8000 from numbers(8192) on node1 Executing query insert into s3_low_cardinality select number, number % 8000 from numbers(8192) on node1 http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None Executing query select name from system.zookeeper where path='/test/drop_table/replicas' on node2 Executing query select name from system.zookeeper where path='/test/drop_table/replicas' on node2 http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None Executing query select * from `postgres_database`.`test_data_types` order by id; on instance Executing query select * from `postgres_database`.`test_data_types` order by id; on instance [gw2] PASSED test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0] test_replicated_user_defined_functions/test.py::test_create_and_replace Executing query CREATE FUNCTION f1 AS (x, y) -> x + y on node1 Executing query CREATE FUNCTION f1 AS (x, y) -> x + y on node1 http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Executing query insert into s3_low_cardinality select number = 0 ? 0 : (number + 8192 * 1), number % 8000 + 1 * 8192 from numbers(8192) on node1 Executing query insert into s3_low_cardinality select number = 0 ? 0 : (number + 8192 * 1), number % 8000 + 1 * 8192 from numbers(8192) on node1 http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None Executing query create table test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3' on node1 Executing query create table test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3' on node1 http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Executing query SELECT f1(12, 3) on node1 Executing query SELECT f1(12, 3) on node1 http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None Executing query select * from `test_database`.`test_data_types` order by id; on instance Executing query select * from `test_database`.`test_data_types` order by id; on instance http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None Executing query insert into s3_low_cardinality select number = 0 ? 0 : (number + 8192 * 2), number % 8000 + 2 * 8192 from numbers(8192) on node1 Executing query insert into s3_low_cardinality select number = 0 ? 0 : (number + 8192 * 2), number % 8000 + 2 * 8192 from numbers(8192) on node1 Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Stopped Stopping zookeeper node: zoo2 Stopping zookeeper node: zoo2 Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo2] Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo2] Executing query create table test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '2') order by n partition by n % 99 settings storage_policy='s3' on node2 Executing query create table test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '2') order by n partition by n % 99 settings storage_policy='s3' on node2 http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Executing query CREATE FUNCTION f1 AS (x, y) -> x + 2 * y on node1 Executing query CREATE FUNCTION f1 AS (x, y) -> x + 2 * y on node1 http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None Executing query SELECT * FROM test_database.test_data_types ORDER BY id LIMIT 1; on instance Executing query SELECT * FROM test_database.test_data_types ORDER BY id LIMIT 1; on instance http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/138b7e94258d69aa516a2afeb2a97cd774faef6be9577a4ade703d54c6720674/json HTTP/1.1" 200 None ClickHouse node started ClickHouse node started get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestscheduler-gw1-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestscheduler-gw1-node2-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestscheduler-gw1-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestscheduler-gw1-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Waiting for ClickHouse start in node2, ip: 172.16.4.10... Waiting for ClickHouse start in node2, ip: 172.16.4.10... http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestscheduler-gw1-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestscheduler-gw1-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2fcd3ef941410009d252da71c42df265c3aa8c71b43d1346d47f95388946e19e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2fcd3ef941410009d252da71c42df265c3aa8c71b43d1346d47f95388946e19e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None ClickHouse node2 started ClickHouse node2 started http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:1521 Stdout:1521 http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Clickhouse process running. Clickhouse process running. run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:1521 Stdout:1521 Executing query select 20 on node Executing query select 20 on node Executing query insert into test_drop_table select * from numbers(1000) on node1 Executing query insert into test_drop_table select * from numbers(1000) on node1 http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Executing query optimize table s3_low_cardinality final on node1 Executing query optimize table s3_low_cardinality final on node1 Executing query SELECT * FROM `test_database`.`test_data_types` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`test_data_types` LIMIT 1 FORMAT Null on instance run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Executing query CREATE FUNCTION IF NOT EXISTS f1 AS (x, y) -> x + 3 * y on node1 Executing query CREATE FUNCTION IF NOT EXISTS f1 AS (x, y) -> x + 3 * y on node1 run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Executing query system reload config on node Executing query system reload config on node http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Executing query SELECT f1(12, 3) on node1 Executing query SELECT f1(12, 3) on node1 Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Stopped Stopping zookeeper node: zoo3 Stopping zookeeper node: zoo3 Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo3] Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo3] http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_data_types' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_data_types' on instance http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Executing query select * from s3_low_cardinality where key = 9000 on node1 Executing query select * from s3_low_cardinality where key = 9000 on node1 Executing query select 20 on node Executing query select 20 on node http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Executing query create resource io_write (write disk s3_no_resource); create resource io_read (read disk s3_no_resource); create workload all settings max_cost = 1000000 for io_write, max_cost = 2000000 for io_read; create workload admin in all settings priority = 0; create workload production in all settings priority = 1, weight = 9; create workload development in all settings priority = 1, weight = 1; on node Executing query create resource io_write (write disk s3_no_resource); create resource io_read (read disk s3_no_resource); create workload all settings max_cost = 1000000 for io_write, max_cost = 2000000 for io_read; create workload admin in all settings priority = 0; create workload production in all settings priority = 1, weight = 9; create workload development in all settings priority = 1, weight = 1; on node http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Executing query select * from `postgres_database`.`test_data_types` order by id; on instance Executing query select * from `postgres_database`.`test_data_types` order by id; on instance Executing query CREATE OR REPLACE FUNCTION f1 AS (x, y) -> x + 4 * y on node1 Executing query CREATE OR REPLACE FUNCTION f1 AS (x, y) -> x + 4 * y on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Executing query select count() from system.scheduler where path ilike '%/admin/%' and type='fifo' on node Executing query select count() from system.scheduler where path ilike '%/admin/%' and type='fifo' on node Executing query SELECT f1(12, 3) on node1 Executing query SELECT f1(12, 3) on node1 http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Executing query drop table if exists s3_low_cardinality on node1 Executing query drop table if exists s3_low_cardinality on node1 [gw7] PASSED test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 Executing query select * from `test_database`.`test_data_types` order by id; on instance Executing query select * from `test_database`.`test_data_types` order by id; on instance http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Stopped Starting zookeeper node: zoo1 Starting zookeeper node: zoo1 Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo1] Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo1] http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Executing query create table s3_low_cardinality (x LowCardinality(String)) engine = MergeTree order by tuple() settings min_bytes_for_wide_part=0, storage_policy = 's3', max_compress_block_size=10000 on node1 Executing query create table s3_low_cardinality (x LowCardinality(String)) engine = MergeTree order by tuple() settings min_bytes_for_wide_part=0, storage_policy = 's3', max_compress_block_size=10000 on node1 Executing query select 20 on node Executing query select 20 on node Executing query DROP FUNCTION f1 on node1 Executing query DROP FUNCTION f1 on node1 http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Executing query select count() from system.scheduler where path ilike '%/admin' and type='unified' and priority=0 on node Executing query select count() from system.scheduler where path ilike '%/admin' and type='unified' and priority=0 on node http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Executing query CREATE FUNCTION f1 AS (x, y) -> x + y on node1 Executing query CREATE FUNCTION f1 AS (x, y) -> x + y on node1 http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None [gw2] PASSED test_replicated_user_defined_functions/test.py::test_create_and_replace http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None test_replicated_user_defined_functions/test.py::test_drop_if_exists Executing query insert into s3_low_cardinality select toString(number % 8000) || if(number < 8192 * 3, 'aaaaaaaaaaaaaaaa', if(number < 8192 * 6, 'bbbbbbbbbbbbbbbbbbbbbbbb', 'ccccccccccccccccccc')) from numbers(8192 * 9) on node1 Executing query insert into s3_low_cardinality select toString(number % 8000) || if(number < 8192 * 3, 'aaaaaaaaaaaaaaaa', if(number < 8192 * 6, 'bbbbbbbbbbbbbbbbbbbbbbbb', 'ccccccccccccccccccc')) from numbers(8192 * 9) on node1 Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Started Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Started Starting zookeeper node: zoo2 Starting zookeeper node: zoo2 Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo2] Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo2] http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Executing query select count() from system.scheduler where path ilike '%/production/%' and type='fifo' on node Executing query select count() from system.scheduler where path ilike '%/production/%' and type='fifo' on node http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Executing query DROP FUNCTION IF EXISTS f1 on node1 Executing query DROP FUNCTION IF EXISTS f1 on node1 http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None Executing query select 20 on node Executing query select 20 on node http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93064f90b6e6cf271f0457fb835fb3687bcbc72a66820e5289fe9f834fdf6d09/json HTTP/1.1" 200 None ClickHouse node started ClickHouse node started Executing query CREATE TABLE distributed (id UInt32) ENGINE = Distributed('test_cluster', 'default', 'replicated') on node Executing query CREATE TABLE distributed (id UInt32) ENGINE = Distributed('test_cluster', 'default', 'replicated') on node Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Started Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Started Starting zookeeper node: zoo3 Starting zookeeper node: zoo3 Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo3] Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo3] Executing query DROP FUNCTION IF EXISTS f1 on node1 Executing query DROP FUNCTION IF EXISTS f1 on node1 Executing query select count() from system.scheduler where path ilike '%/production' and type='unified' and weight=9 on node Executing query select count() from system.scheduler where path ilike '%/production' and type='unified' and weight=9 on node Executing query CREATE TABLE distributed2 (id UInt32) ENGINE = Distributed('test_cluster2', 'default', 'replicated') on node Executing query CREATE TABLE distributed2 (id UInt32) ENGINE = Distributed('test_cluster2', 'default', 'replicated') on node Executing query select uniq(x) from s3_low_cardinality settings max_threads=2, merge_tree_min_rows_for_concurrent_read_for_remote_filesystem=1, merge_tree_min_bytes_for_concurrent_read_for_remote_filesystem=1 on node1 Executing query select uniq(x) from s3_low_cardinality settings max_threads=2, merge_tree_min_rows_for_concurrent_read_for_remote_filesystem=1, merge_tree_min_bytes_for_concurrent_read_for_remote_filesystem=1 on node1 Executing query DROP FUNCTION f1 on node1 Executing query DROP FUNCTION f1 on node1 Executing query select * from `test_database`.`test_data_types` order by id; on instance Executing query select * from `test_database`.`test_data_types` order by id; on instance Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Started Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Started get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.9.2, port:2281, use_ssl:True get_kazoo_client: zoo1, ip:172.16.9.2, port:2281, use_ssl:True Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query select count() from system.scheduler where path ilike '%/development/%' and type='fifo' on node Executing query select count() from system.scheduler where path ilike '%/development/%' and type='fifo' on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query CREATE FUNCTION f1 AS (x, y) -> x + y on node1 Executing query CREATE FUNCTION f1 AS (x, y) -> x + y on node1 [gw2] PASSED test_replicated_user_defined_functions/test.py::test_drop_if_exists test_replicated_user_defined_functions/test.py::test_reload_zookeeper Executing query select 20 on node Executing query select 20 on node Executing query INSERT INTO postgres_database.test_array_data_type VALUES (0, ['2000-05-12', '2000-05-12'], ['2000-05-12 12:12:12.012345', '2000-05-12 12:12:12.012345'], [[1.12345], [1.12345], [1.12345]], [[1.1234567891], [1.1234567891], [1.1234567891]], [[[0.11111, 0.11111]], [[0.22222, 0.22222]], [[0.33333, 0.33333]]], [[[1, 1], [1, 1]], [[3, 3], [3, 3]], [[4, 4], [5, 5]]], [[[[['winx', 'winx', 'winx']]]]], [[[1, NULL], [NULL, 1]], [[NULL, NULL], [NULL, NULL]], [[4, 4], [5, 5]]], [[[[NULL]]]], []) on instance Executing query INSERT INTO postgres_database.test_array_data_type VALUES (0, ['2000-05-12', '2000-05-12'], ['2000-05-12 12:12:12.012345', '2000-05-12 12:12:12.012345'], [[1.12345], [1.12345], [1.12345]], [[1.1234567891], [1.1234567891], [1.1234567891]], [[[0.11111, 0.11111]], [[0.22222, 0.22222]], [[0.33333, 0.33333]]], [[[1, 1], [1, 1]], [[3, 3], [3, 3]], [[4, 4], [5, 5]]], [[[[['winx', 'winx', 'winx']]]]], [[[1, NULL], [NULL, 1]], [[NULL, NULL], [NULL, NULL]], [[4, 4], [5, 5]]], [[[[NULL]]]], []) on instance http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/.env --project-name roottests3lowcardinalityrightborder-gw7 --file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/.env --project-name roottests3lowcardinalityrightborder-gw7 --file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] [gw7] PASSED test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Executing query SELECT name FROM system.functions WHERE name ='f1' on node2 Executing query SELECT name FROM system.functions WHERE name ='f1' on node2 run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/num_levels/no_such_column_family_option/g' /etc/clickhouse-server/config.d/rocksdb.xml"] [gw5] PASSED test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/num_levels/no_such_column_family_option/g' /etc/clickhouse-server/config.d/rocksdb.xml"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c sed -i 's/num_levels/no_such_column_family_option/g' /etc/clickhouse-server/config.d/rocksdb.xml] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c sed -i 's/num_levels/no_such_column_family_option/g' /etc/clickhouse-server/config.d/rocksdb.xml] Executing query select count() from system.scheduler where path ilike '%/all/%' and type='inflight_limit' and resource='io_write' and max_cost=1000000 on node Executing query select count() from system.scheduler where path ilike '%/all/%' and type='inflight_limit' and resource='io_write' and max_cost=1000000 on node Executing query SELECT * FROM `test_database`.`test_array_data_type` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`test_array_data_type` LIMIT 1 FORMAT Null on instance run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c ps -C clickhouse] Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 1521 ? 00:00:03 clickhouse Stdout: 1521 ? 00:00:03 clickhouse run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c pkill clickhouse] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo1\n 2181\n \n 2000\n \n\' > /etc/clickhouse-server/conf.d/zookeeper.xml'] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo1\n 2181\n \n 2000\n \n\' > /etc/clickhouse-server/conf.d/zookeeper.xml'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c echo ' zoo1 2181 2000 ' > /etc/clickhouse-server/conf.d/zookeeper.xml] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c echo ' zoo1 2181 2000 ' > /etc/clickhouse-server/conf.d/zookeeper.xml] Executing query ALTER TABLE test_rename_distributed ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 Executing query ALTER TABLE test_rename_distributed ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 Stdout:1521 Stdout:1521 Executing query SYSTEM RELOAD CONFIG on node1 Executing query SYSTEM RELOAD CONFIG on node1 Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_array_data_type' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_array_data_type' on instance Executing query select count() from system.scheduler where path ilike '%/all/%' and type='inflight_limit' and resource='io_read' and max_cost=2000000 on node Executing query select count() from system.scheduler where path ilike '%/all/%' and type='inflight_limit' and resource='io_read' and max_cost=2000000 on node Executing query select * from `postgres_database`.`test_array_data_type` order by key; on instance Executing query select * from `postgres_database`.`test_array_data_type` order by key; on instance run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestscheduler-gw1-node-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestscheduler-gw1-node-1 bash -c ps -C clickhouse] Executing query ALTER TABLE test_rename_distributed_replicated ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 Executing query ALTER TABLE test_rename_distributed_replicated ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 8 ? 00:00:03 clickhouse Stdout: 8 ? 00:00:03 clickhouse run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestscheduler-gw1-node-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestscheduler-gw1-node-1 bash -c pkill clickhouse] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestscheduler-gw1-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo1\n 2181\n \n 2000\n \n\' > /etc/clickhouse-server/conf.d/zookeeper.xml'] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo1\n 2181\n \n 2000\n \n\' > /etc/clickhouse-server/conf.d/zookeeper.xml'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c echo ' zoo1 2181 2000 ' > /etc/clickhouse-server/conf.d/zookeeper.xml] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c echo ' zoo1 2181 2000 ' > /etc/clickhouse-server/conf.d/zookeeper.xml] Executing query select * from `test_database`.`test_array_data_type` order by key; on instance Executing query select * from `test_database`.`test_array_data_type` order by key; on instance Stdout:8 Stdout:8 Executing query SYSTEM RELOAD CONFIG on node2 Executing query SYSTEM RELOAD CONFIG on node2 Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Connection dropped: socket connection broken Connection dropped: socket connection broken run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:1521 Stdout:1521 Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Executing query CREATE FUNCTION f2 AS () -> (SELECT sum(s) FROM (SELECT 1 as s UNION ALL SELECT 1 as s)) on node1 Executing query CREATE FUNCTION f2 AS () -> (SELECT sum(s) FROM (SELECT 1 as s UNION ALL SELECT 1 as s)) on node1 Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['zookeeper', 'clickhouse'] Received response(xid=1): ['zookeeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() Closing connection to 172.16.9.2:2281 Closing connection to 172.16.9.2:2281 Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.9.3, port:2281, use_ssl:True get_kazoo_client: zoo2, ip:172.16.9.3, port:2281, use_ssl:True Connecting to 172.16.9.3(172.16.9.3):2281, use_ssl: True Connecting to 172.16.9.3(172.16.9.3):2281, use_ssl: True http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2'] ORDER BY name on node2 Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2'] ORDER BY name on node2 run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestscheduler-gw1-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8 Stdout:8 Stopping zookeeper node: zoo1 Stopping zookeeper node: zoo1 Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo1] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo1] Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Executing query select * from `test_database`.`test_array_data_type` order by key; on instance Executing query select * from `test_database`.`test_array_data_type` order by key; on instance Received response(xid=1): ['zookeeper', 'clickhouse'] Received response(xid=1): ['zookeeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() Closing connection to 172.16.9.3:2281 Closing connection to 172.16.9.3:2281 Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.9.4, port:2281, use_ssl:True get_kazoo_client: zoo3, ip:172.16.9.4, port:2281, use_ssl:True Connecting to 172.16.9.4(172.16.9.4):2281, use_ssl: True Connecting to 172.16.9.4(172.16.9.4):2281, use_ssl: True run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Stdout:1521 Stdout:1521 Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Executing query SELECT * FROM test_database.test_array_data_type ORDER BY key; on instance Executing query SELECT * FROM test_database.test_array_data_type ORDER BY key; on instance Received response(xid=1): ['zookeeper', 'clickhouse'] Received response(xid=1): ['zookeeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() Closing connection to 172.16.9.4:2281 Closing connection to 172.16.9.4:2281 Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ['zoo1', 'zoo2', 'zoo3'] All instances of ZooKeeper started: ['zoo1', 'zoo2', 'zoo3'] run container_id:roottestreloadclientcertificate-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] run container_id:roottestreloadclientcertificate-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] Command:[docker exec roottestreloadclientcertificate-gw9-node1-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] Command:[docker exec roottestreloadclientcertificate-gw9-node1-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] run container_id:roottestreloadclientcertificate-gw9-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] run container_id:roottestreloadclientcertificate-gw9-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] Command:[docker exec roottestreloadclientcertificate-gw9-node2-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] Command:[docker exec roottestreloadclientcertificate-gw9-node2-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] run container_id:roottestreloadclientcertificate-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/third_client.crt\n /etc/clickhouse-server/config.d/third_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] run container_id:roottestreloadclientcertificate-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/third_client.crt\n /etc/clickhouse-server/config.d/third_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] Command:[docker exec roottestreloadclientcertificate-gw9-node1-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/third_client.crt /etc/clickhouse-server/config.d/third_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] Command:[docker exec roottestreloadclientcertificate-gw9-node1-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/third_client.crt /etc/clickhouse-server/config.d/third_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] run container_id:roottestreloadclientcertificate-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] run container_id:roottestreloadclientcertificate-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] Command:[docker exec roottestreloadclientcertificate-gw9-node1-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] Command:[docker exec roottestreloadclientcertificate-gw9-node1-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/data/env_node/test.csv', 'minio', 'minio123', 'CSV', 'key String, value String') VALUES ('color','red'),('size','10') on env_node Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/data/env_node/test.csv', 'minio', 'minio123', 'CSV', 'key String, value String') VALUES ('color','red'),('size','10') on env_node [gw4] PASSED test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy run container_id:roottestreloadclientcertificate-gw9-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/third_client.crt\n /etc/clickhouse-server/config.d/third_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] run container_id:roottestreloadclientcertificate-gw9-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/third_client.crt\n /etc/clickhouse-server/config.d/third_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] Command:[docker exec roottestreloadclientcertificate-gw9-node2-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/third_client.crt /etc/clickhouse-server/config.d/third_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] Command:[docker exec roottestreloadclientcertificate-gw9-node2-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/third_client.crt /etc/clickhouse-server/config.d/third_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance run container_id:roottestreloadclientcertificate-gw9-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] run container_id:roottestreloadclientcertificate-gw9-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] Command:[docker exec roottestreloadclientcertificate-gw9-node2-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] Command:[docker exec roottestreloadclientcertificate-gw9-node2-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestscheduler-gw1-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestscheduler-gw1-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestscheduler-gw1-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestscheduler-gw1-node-1/exec HTTP/1.1" 201 74 Executing query DROP DATABASE IF EXISTS "postgres_database" on instance [gw0] PASSED test_postgresql_replica_database_engine_1/test.py::test_different_data_types Executing query DROP DATABASE IF EXISTS "postgres_database" on instance http://localhost:None "POST /v1.46/exec/bb0f99dfbd8c089c4d2a1667dfe48e830175c6e297e5ada03408e1211d8d3cb4/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/bb0f99dfbd8c089c4d2a1667dfe48e830175c6e297e5ada03408e1211d8d3cb4/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/bb0f99dfbd8c089c4d2a1667dfe48e830175c6e297e5ada03408e1211d8d3cb4/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/bb0f99dfbd8c089c4d2a1667dfe48e830175c6e297e5ada03408e1211d8d3cb4/json HTTP/1.1" 200 586 Executing query SELECT * FROM s3('http://minio1:9001/root/data/env_node/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on env_node Executing query SELECT * FROM s3('http://minio1:9001/root/data/env_node/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on env_node Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw5-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw5-node-1/exec HTTP/1.1" 201 74 Executing query SELECT * FROM s3('http://minio1:9001/root/data/env_node/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on env_node Executing query SELECT * FROM s3('http://minio1:9001/root/data/env_node/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on env_node Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance http://localhost:None "POST /v1.46/exec/3cb368ff2c7e90589ee696ef6939dfa65a60390e081ca738c2ec08e70046485f/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/3cb368ff2c7e90589ee696ef6939dfa65a60390e081ca738c2ec08e70046485f/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/3cb368ff2c7e90589ee696ef6939dfa65a60390e081ca738c2ec08e70046485f/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/3cb368ff2c7e90589ee696ef6939dfa65a60390e081ca738c2ec08e70046485f/json HTTP/1.1" 200 586 test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished Executing query INSERT INTO `postgres_database`.postgresql_replica_0 SELECT number, number from numbers(100000) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_0 SELECT number, number from numbers(100000) on instance http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestscheduler-gw1-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:772 Stdout:772 Clickhouse process running. Clickhouse process running. run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestscheduler-gw1-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:772 Stdout:772 Executing query select 20 on node Executing query select 20 on node run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:2298 Stdout:2298 Clickhouse process running. Clickhouse process running. run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:2298 Stdout:2298 Executing query select 20 on node Executing query select 20 on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Executing query select 20 on node Executing query select 20 on node Executing query INSERT INTO `postgres_database`.postgresql_replica_1 SELECT number, number from numbers(100000) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_1 SELECT number, number from numbers(100000) on instance Executing query select 20 on node Executing query select 20 on node Executing query select 20 on node Executing query select 20 on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Executing query select 20 on node Executing query select 20 on node Executing query select 20 on node Executing query select 20 on node Executing query system sync replica test_drop_table on node2 Executing query system sync replica test_drop_table on node2 Executing query INSERT INTO `postgres_database`.postgresql_replica_2 SELECT number, number from numbers(100000) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_2 SELECT number, number from numbers(100000) on instance Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Executing query select 20 on node Executing query select 20 on node Executing query select 20 on node Executing query select 20 on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "POST /v1.46/containers/create HTTP/1.1" 201 88 http://localhost:None "POST /v1.46/containers/create HTTP/1.1" 201 88 http://localhost:None "GET /v1.46/containers/070e72e940df375dcf562625c9c3cde10cd22e662468382b293978539011663d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/070e72e940df375dcf562625c9c3cde10cd22e662468382b293978539011663d/json HTTP/1.1" 200 None http://localhost:None "POST /v1.46/containers/070e72e940df375dcf562625c9c3cde10cd22e662468382b293978539011663d/start HTTP/1.1" 204 0 http://localhost:None "POST /v1.46/containers/070e72e940df375dcf562625c9c3cde10cd22e662468382b293978539011663d/start HTTP/1.1" 204 0 [network] Created new container 070e72e940df375dcf562625c9c3cde10cd22e662468382b293978539011663d [network] Created new container 070e72e940df375dcf562625c9c3cde10cd22e662468382b293978539011663d http://localhost:None "POST /v1.46/containers/070e72e940df375dcf562625c9c3cde10cd22e662468382b293978539011663d/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/070e72e940df375dcf562625c9c3cde10cd22e662468382b293978539011663d/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/f13ed9c35615252f2c1c1a77d20ce56f98c24ecfcbf8587d4f4d32114267509e/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/f13ed9c35615252f2c1c1a77d20ce56f98c24ecfcbf8587d4f4d32114267509e/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/f13ed9c35615252f2c1c1a77d20ce56f98c24ecfcbf8587d4f4d32114267509e/json HTTP/1.1" 200 549 http://localhost:None "GET /v1.46/exec/f13ed9c35615252f2c1c1a77d20ce56f98c24ecfcbf8587d4f4d32114267509e/json HTTP/1.1" 200 549 [network] 070e72e940df375dcf562625c9c3cde10cd22e662468382b293978539011663d: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-m', 'statistic', '--mode', 'random', '--probability', '0.01', '-p', 'tcp', '-d', '172.16.7.11', '--sport', '2181', '-j', 'REJECT', '--reject-with', 'tcp-reset'] (0): [network] 070e72e940df375dcf562625c9c3cde10cd22e662468382b293978539011663d: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-m', 'statistic', '--mode', 'random', '--probability', '0.01', '-p', 'tcp', '-d', '172.16.7.11', '--sport', '2181', '-j', 'REJECT', '--reject-with', 'tcp-reset'] (0): http://localhost:None "POST /v1.46/containers/070e72e940df375dcf562625c9c3cde10cd22e662468382b293978539011663d/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/070e72e940df375dcf562625c9c3cde10cd22e662468382b293978539011663d/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/0f0a5ce6e53b37a3e94e13eec60ccd1e2287b3ae34085861719f28199073c5d2/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/0f0a5ce6e53b37a3e94e13eec60ccd1e2287b3ae34085861719f28199073c5d2/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/0f0a5ce6e53b37a3e94e13eec60ccd1e2287b3ae34085861719f28199073c5d2/json HTTP/1.1" 200 549 http://localhost:None "GET /v1.46/exec/0f0a5ce6e53b37a3e94e13eec60ccd1e2287b3ae34085861719f28199073c5d2/json HTTP/1.1" 200 549 [network] 070e72e940df375dcf562625c9c3cde10cd22e662468382b293978539011663d: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-m', 'statistic', '--mode', 'random', '--probability', '0.01', '-p', 'tcp', '-s', '172.16.7.11', '--dport', '2181', '-j', 'REJECT', '--reject-with', 'tcp-reset'] (0): [network] 070e72e940df375dcf562625c9c3cde10cd22e662468382b293978539011663d: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-m', 'statistic', '--mode', 'random', '--probability', '0.01', '-p', 'tcp', '-s', '172.16.7.11', '--dport', '2181', '-j', 'REJECT', '--reject-with', 'tcp-reset'] (0): Executing query drop table test_drop_table on node1 Executing query drop table test_drop_table on node1 Executing query select count() from system.scheduler where path ilike '%/admin/%' and type='fifo' on node Executing query select count() from system.scheduler where path ilike '%/admin/%' and type='fifo' on node Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed (num,foo2) SELECT number + 0 AS num, number + 1 + 0 AS foo2 FROM numbers_mt(1000) on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed (num,foo2) SELECT number + 0 AS num, number + 1 + 0 AS foo2 FROM numbers_mt(1000) on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query select 20 on node Executing query select 20 on node Executing query select count() from system.scheduler where path ilike '%/admin' and type='unified' and priority=0 on node Executing query select count() from system.scheduler where path ilike '%/admin' and type='unified' and priority=0 on node Executing query select count() from system.scheduler where path ilike '%/production/%' and type='fifo' on node Executing query select count() from system.scheduler where path ilike '%/production/%' and type='fifo' on node Executing query INSERT INTO `postgres_database`.postgresql_replica_3 SELECT number, number from numbers(100000) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_3 SELECT number, number from numbers(100000) on instance Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query select count() from system.scheduler where path ilike '%/production' and type='unified' and weight=9 on node Executing query select count() from system.scheduler where path ilike '%/production' and type='unified' and weight=9 on node run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/no_such_column_family_option/num_levels/g' /etc/clickhouse-server/config.d/rocksdb.xml"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/no_such_column_family_option/num_levels/g' /etc/clickhouse-server/config.d/rocksdb.xml"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c sed -i 's/no_such_column_family_option/num_levels/g' /etc/clickhouse-server/config.d/rocksdb.xml] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c sed -i 's/no_such_column_family_option/num_levels/g' /etc/clickhouse-server/config.d/rocksdb.xml] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c ps -C clickhouse] Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 2298 ? 00:00:03 clickhouse Stdout: 2298 ? 00:00:03 clickhouse run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c pkill clickhouse] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:2298 Stdout:2298 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query select count() from system.scheduler where path ilike '%/development/%' and type='fifo' on node Executing query select count() from system.scheduler where path ilike '%/development/%' and type='fifo' on node Executing query select count() from system.scheduler where path ilike '%/all/%' and type='inflight_limit' and resource='io_write' and max_cost=1000000 on node Executing query select count() from system.scheduler where path ilike '%/all/%' and type='inflight_limit' and resource='io_write' and max_cost=1000000 on node Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Executing query INSERT INTO `postgres_database`.postgresql_replica_4 SELECT number, number from numbers(100000) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_4 SELECT number, number from numbers(100000) on instance Executing query select count() from system.scheduler where path ilike '%/all/%' and type='inflight_limit' and resource='io_read' and max_cost=2000000 on node Executing query select count() from system.scheduler where path ilike '%/all/%' and type='inflight_limit' and resource='io_read' and max_cost=2000000 on node [gw1] PASSED test_scheduler/test.py::test_create_workload Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 test_scheduler/test.py::test_merge_workload Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:2298 Stdout:2298 run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Executing query system reload config on node Executing query system reload config on node Executing query SELECT count() FROM test_rename_distributed WHERE foo2 % 1000 > 0 on node1 Executing query SELECT count() FROM test_rename_distributed WHERE foo2 % 1000 > 0 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3'; on node Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3'; on node Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/sys/merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/sys/merges' on node run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:2298 Stdout:2298 Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query SELECT count() FROM test_rename_distributed WHERE foo2 % 1000 > 0 on node1 Executing query SELECT count() FROM test_rename_distributed WHERE foo2 % 1000 > 0 on node1 Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/sys/merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/sys/merges' on node Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopped Stopping zookeeper node: zoo2 Stopping zookeeper node: zoo2 Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo2] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo2] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Executing query insert into data select * from numbers(1e4) on node Executing query insert into data select * from numbers(1e4) on node Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query insert into data select * from numbers(2e4) on node Executing query insert into data select * from numbers(2e4) on node Executing query SELECT count() FROM test_rename_distributed WHERE foo2 % 1000 > 0 on node1 Executing query SELECT count() FROM test_rename_distributed WHERE foo2 % 1000 > 0 on node1 run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:2298 Stdout:2298 Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopped Stopping zookeeper node: zoo3 Stopping zookeeper node: zoo3 Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo3] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo3] Executing query insert into data select * from numbers(3e4) on node Executing query insert into data select * from numbers(3e4) on node Executing query SELECT count() FROM test_rename_distributed WHERE foo2 % 1000 > 0 on node1 Executing query SELECT count() FROM test_rename_distributed WHERE foo2 % 1000 > 0 on node1 Executing query optimize table data final on node Executing query optimize table data final on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/sys/merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/sys/merges' on node Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query SELECT count() FROM test_rename_distributed WHERE foo2 % 1000 > 0 on node1 Executing query SELECT count() FROM test_rename_distributed WHERE foo2 % 1000 > 0 on node1 Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/sys/merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/sys/merges' on node run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw5-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw5-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/64db7e2dc5d2a413d746a5c464b22904c47efcd96df6d975bfe51eecee06f07f/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/64db7e2dc5d2a413d746a5c464b22904c47efcd96df6d975bfe51eecee06f07f/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/64db7e2dc5d2a413d746a5c464b22904c47efcd96df6d975bfe51eecee06f07f/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/64db7e2dc5d2a413d746a5c464b22904c47efcd96df6d975bfe51eecee06f07f/json HTTP/1.1" 200 586 Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance [gw1] PASSED test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node grep in log called Reloaded certificate (/etc/clickhouse-server/config.d/third_client.crt) grep in log called Reloaded certificate (/etc/clickhouse-server/config.d/third_client.crt) run container_id:roottestreloadclientcertificate-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -a "Reloaded certificate (/etc/clickhouse-server/config.d/third_client.crt)" /var/log/clickhouse-server/clickhouse-server.log* || true'] run container_id:roottestreloadclientcertificate-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -a "Reloaded certificate (/etc/clickhouse-server/config.d/third_client.crt)" /var/log/clickhouse-server/clickhouse-server.log* || true'] Command:[docker exec roottestreloadclientcertificate-gw9-node1-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -a "Reloaded certificate (/etc/clickhouse-server/config.d/third_client.crt)" /var/log/clickhouse-server/clickhouse-server.log* || true] Command:[docker exec roottestreloadclientcertificate-gw9-node1-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -a "Reloaded certificate (/etc/clickhouse-server/config.d/third_client.crt)" /var/log/clickhouse-server/clickhouse-server.log* || true] Stdout:2025.04.02 02:53:35.958928 [ 662 ] {} CertificateReloader: Reloaded certificate (/etc/clickhouse-server/config.d/third_client.crt) and key (/etc/clickhouse-server/config.d/third_client.key). Stdout:2025.04.02 02:53:35.958928 [ 662 ] {} CertificateReloader: Reloaded certificate (/etc/clickhouse-server/config.d/third_client.crt) and key (/etc/clickhouse-server/config.d/third_client.key). grep result 2025.04.02 02:53:35.958928 [ 662 ] {} CertificateReloader: Reloaded certificate (/etc/clickhouse-server/config.d/third_client.crt) and key (/etc/clickhouse-server/config.d/third_client.key). grep result 2025.04.02 02:53:35.958928 [ 662 ] {} CertificateReloader: Reloaded certificate (/etc/clickhouse-server/config.d/third_client.crt) and key (/etc/clickhouse-server/config.d/third_client.key). Stopping zookeeper node: zoo1 Stopping zookeeper node: zoo1 Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo1] Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo1] Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query DROP TABLE IF EXISTS test_rename_distributed ON CLUSTER test_cluster SYNC on node1 Executing query DROP TABLE IF EXISTS test_rename_distributed ON CLUSTER test_cluster SYNC on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query system reload config on node Executing query system reload config on node Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance Executing query DROP TABLE IF EXISTS test_rename_distributed_replicated ON CLUSTER test_cluster SYNC on node1 Executing query DROP TABLE IF EXISTS test_rename_distributed_replicated ON CLUSTER test_cluster SYNC on node1 Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3'; on node Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3'; on node Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Stopped Stopping zookeeper node: zoo2 Stopping zookeeper node: zoo2 Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo2] Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo2] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:3089 Stdout:3089 Clickhouse process running. Clickhouse process running. run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Stdout:3089 Stdout:3089 Executing query select 20 on node Executing query select 20 on node run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo 'prod_merges' > /etc/clickhouse-server/config.d/workloads.xml"] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo 'prod_merges' > /etc/clickhouse-server/config.d/workloads.xml"] Command:[docker exec roottestscheduler-gw1-node-1 bash -c echo 'prod_merges' > /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c echo 'prod_merges' > /etc/clickhouse-server/config.d/workloads.xml] Executing query system reload config on node Executing query system reload config on node [gw4] PASSED test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/data/proxy_list_node/test.csv', 'minio', 'minio123', 'CSV', 'key String, value String') VALUES ('color','red'),('size','10') on proxy_list_node Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/data/proxy_list_node/test.csv', 'minio', 'minio123', 'CSV', 'key String, value String') VALUES ('color','red'),('size','10') on proxy_list_node Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Stopped Stopping zookeeper node: zoo3 Stopping zookeeper node: zoo3 Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo3] Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo3] Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_merges' on node Executing query select 20 on node Executing query select 20 on node Executing query SELECT * FROM s3('http://minio1:9001/root/data/proxy_list_node/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on proxy_list_node Executing query SELECT * FROM s3('http://minio1:9001/root/data/proxy_list_node/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on proxy_list_node Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_merges' on node Executing query SELECT * FROM s3('http://minio1:9001/root/data/proxy_list_node/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on proxy_list_node Executing query SELECT * FROM s3('http://minio1:9001/root/data/proxy_list_node/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on proxy_list_node Executing query insert into data select * from numbers(1e4) on node Executing query insert into data select * from numbers(1e4) on node Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Stopped Starting zookeeper node: zoo1 Starting zookeeper node: zoo1 Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo1] Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo1] Executing query select 20 on node Executing query select 20 on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Executing query insert into data select * from numbers(2e4) on node Executing query insert into data select * from numbers(2e4) on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance [gw3] PASSED test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select Executing query CREATE TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster ( num UInt32, num2 UInt32 DEFAULT num + 1 ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/test/{shard}/test_rename_distributed_parallel_insert_and_select_replicated', '{replica}') ORDER BY num PARTITION BY num % 100; on node1 Executing query CREATE TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster ( num UInt32, num2 UInt32 DEFAULT num + 1 ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/test/{shard}/test_rename_distributed_parallel_insert_and_select_replicated', '{replica}') ORDER BY num PARTITION BY num % 100; on node1 Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Started Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Started Starting zookeeper node: zoo2 Starting zookeeper node: zoo2 Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo2] Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo2] Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query insert into data select * from numbers(3e4) on node Executing query insert into data select * from numbers(3e4) on node Executing query CREATE TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster AS test_rename_distributed_parallel_insert_and_select_replicated ENGINE = Distributed(test_cluster, default, test_rename_distributed_parallel_insert_and_select_replicated, rand()) on node1 Executing query CREATE TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster AS test_rename_distributed_parallel_insert_and_select_replicated ENGINE = Distributed(test_cluster, default, test_rename_distributed_parallel_insert_and_select_replicated, rand()) on node1 Executing query select 20 on node Executing query select 20 on node Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Started Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Started Starting zookeeper node: zoo3 Starting zookeeper node: zoo3 Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo3] Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo3] Executing query optimize table data final on node Executing query optimize table data final on node Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/max_background_jobs/no_such_option/g' /etc/clickhouse-server/config.d/rocksdb.xml"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/max_background_jobs/no_such_option/g' /etc/clickhouse-server/config.d/rocksdb.xml"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c sed -i 's/max_background_jobs/no_such_option/g' /etc/clickhouse-server/config.d/rocksdb.xml] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c sed -i 's/max_background_jobs/no_such_option/g' /etc/clickhouse-server/config.d/rocksdb.xml] [gw5] PASSED test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c ps -C clickhouse] Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(1000) on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(1000) on node1 Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 3089 ? 00:00:03 clickhouse Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Starting Stdout: 3089 ? 00:00:03 clickhouse Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Started run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Started run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c pkill clickhouse] run container_id:roottestreloadclientcertificate-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] run container_id:roottestreloadclientcertificate-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] Command:[docker exec roottestreloadclientcertificate-gw9-node1-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] Command:[docker exec roottestreloadclientcertificate-gw9-node1-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestreloadclientcertificate-gw9-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] run container_id:roottestreloadclientcertificate-gw9-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] Command:[docker exec roottestreloadclientcertificate-gw9-node2-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] Command:[docker exec roottestreloadclientcertificate-gw9-node2-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Stdout:3089 Stdout:3089 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_merges' on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.9.2, port:2281, use_ssl:True get_kazoo_client: zoo1, ip:172.16.9.2, port:2281, use_ssl:True Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_merges' on node Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo 'dev_merges' > /etc/clickhouse-server/config.d/workloads.xml"] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo 'dev_merges' > /etc/clickhouse-server/config.d/workloads.xml"] Command:[docker exec roottestscheduler-gw1-node-1 bash -c echo 'dev_merges' > /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c echo 'dev_merges' > /etc/clickhouse-server/config.d/workloads.xml] Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query system reload config on node Executing query system reload config on node run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_merges' on node Stdout:3089 Stdout:3089 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_merges' on node Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance Executing query insert into data select * from numbers(1e4) on node Executing query insert into data select * from numbers(1e4) on node Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Connection dropped: socket connection broken Connection dropped: socket connection broken Executing query insert into data select * from numbers(2e4) on node Executing query insert into data select * from numbers(2e4) on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:3089 Stdout:3089 Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Executing query insert into data select * from numbers(3e4) on node Executing query insert into data select * from numbers(3e4) on node Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['zookeeper', 'clickhouse'] Received response(xid=1): ['zookeeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() Closing connection to 172.16.9.2:2281 Closing connection to 172.16.9.2:2281 Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.9.3, port:2281, use_ssl:True get_kazoo_client: zoo2, ip:172.16.9.3, port:2281, use_ssl:True Connecting to 172.16.9.3(172.16.9.3):2281, use_ssl: True Connecting to 172.16.9.3(172.16.9.3):2281, use_ssl: True Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['zookeeper', 'clickhouse'] Received response(xid=1): ['zookeeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() Closing connection to 172.16.9.3:2281 Closing connection to 172.16.9.3:2281 Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.9.4, port:2281, use_ssl:True get_kazoo_client: zoo3, ip:172.16.9.4, port:2281, use_ssl:True Connecting to 172.16.9.4(172.16.9.4):2281, use_ssl: True Connecting to 172.16.9.4(172.16.9.4):2281, use_ssl: True Executing query optimize table data final on node Executing query optimize table data final on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_merges' on node Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Received response(xid=1): ['zookeeper', 'clickhouse'] Received response(xid=1): ['zookeeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None Closing connection to 172.16.9.4:2281 Closing connection to 172.16.9.4:2281 Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None All instances of ZooKeeper started: ['zoo1', 'zoo2', 'zoo3'] All instances of ZooKeeper started: ['zoo1', 'zoo2', 'zoo3'] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:3089 Stdout:3089 Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node [gw1] PASSED test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node2 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node2 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo2 to foo3 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo2 to foo3 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo2 to foo3 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo2 to foo3 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo3) SELECT number + 0 AS num, number + 1 + 0 AS foo3 FROM numbers_mt(10) on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo3) SELECT number + 0 AS num, number + 1 + 0 AS foo3 FROM numbers_mt(10) on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(10) on node2 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(10) on node2 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo2) SELECT number + 0 AS num, number + 1 + 0 AS foo2 FROM numbers_mt(10) on node3 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo2) SELECT number + 0 AS num, number + 1 + 0 AS foo2 FROM numbers_mt(10) on node3 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo2 % 1000 > 0 on node1 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo2 % 1000 > 0 on node1 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo3 % 1000 > 0 on node2 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo3 % 1000 > 0 on node2 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node3 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node3 run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopped Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2'] ORDER BY name on node2 Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2'] ORDER BY name on node2 Executing query system reload config on node Executing query system reload config on node Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo2 % 1000 > 0 on node1 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo2 % 1000 > 0 on node1 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo3 % 1000 > 0 on node2 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo3 % 1000 > 0 on node2 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo3) SELECT number + 0 AS num, number + 1 + 0 AS foo3 FROM numbers_mt(10) on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo3) SELECT number + 0 AS num, number + 1 + 0 AS foo3 FROM numbers_mt(10) on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(10) on node2 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(10) on node2 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo2) SELECT number + 0 AS num, number + 1 + 0 AS foo2 FROM numbers_mt(10) on node3 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo2) SELECT number + 0 AS num, number + 1 + 0 AS foo2 FROM numbers_mt(10) on node3 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node3 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node3 run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo3) SELECT number + 0 AS num, number + 1 + 0 AS foo3 FROM numbers_mt(10) on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo3) SELECT number + 0 AS num, number + 1 + 0 AS foo3 FROM numbers_mt(10) on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(10) on node2 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(10) on node2 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo3 % 1000 > 0 on node2 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo3 % 1000 > 0 on node2 Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Stderr: Container roottests3lowcardinalityrightborder-gw7-node1-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw7-node1-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw7-resolver-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw7-resolver-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw7-node1-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw7-node1-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw7-minio1-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw7-minio1-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw7-minio1-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw7-minio1-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw7-resolver-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw7-resolver-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy1-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy1-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy2-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy2-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy1-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy1-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy2-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy2-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Executing query CREATE FUNCTION f3 AS (x, y) -> x * y on node1 Executing query CREATE FUNCTION f3 AS (x, y) -> x * y on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw5-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw5-node-1/exec HTTP/1.1" 201 74 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo2 % 1000 > 0 on node1 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo2 % 1000 > 0 on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/.env --project-name roottests3lowcardinalityrightborder-gw7 --file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/.env --project-name roottests3lowcardinalityrightborder-gw7 --file /ClickHouse/tests/integration/test_s3_low_cardinality_right_border/_instances-0-gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] http://localhost:None "POST /v1.46/exec/a92f2b14be270e1b26dcf927e6c6f0e3ef92bbc24ad7932c4d549d580cf5c100/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/a92f2b14be270e1b26dcf927e6c6f0e3ef92bbc24ad7932c4d549d580cf5c100/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/a92f2b14be270e1b26dcf927e6c6f0e3ef92bbc24ad7932c4d549d580cf5c100/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/a92f2b14be270e1b26dcf927e6c6f0e3ef92bbc24ad7932c4d549d580cf5c100/json HTTP/1.1" 200 586 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo2 to foo3 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo2 to foo3 on node1 Executing query drop table if exists prod_data; drop table if exists dev_data; create table prod_data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3', merge_workload='prod_merges'; create table dev_data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3', merge_workload='dev_merges'; on node Executing query drop table if exists prod_data; drop table if exists dev_data; create table prod_data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3', merge_workload='prod_merges'; create table dev_data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3', merge_workload='dev_merges'; on node Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(10) on node2 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(10) on node2 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo3) SELECT number + 0 AS num, number + 1 + 0 AS foo3 FROM numbers_mt(10) on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo3) SELECT number + 0 AS num, number + 1 + 0 AS foo3 FROM numbers_mt(10) on node1 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo3 % 1000 > 0 on node2 Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo3 % 1000 > 0 on node2 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo2 % 1000 > 0 on node1 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo2 % 1000 > 0 on node1 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node3 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node3 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo2) SELECT number + 0 AS num, number + 1 + 0 AS foo2 FROM numbers_mt(10) on node3 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo2) SELECT number + 0 AS num, number + 1 + 0 AS foo2 FROM numbers_mt(10) on node3 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(10) on node2 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(10) on node2 Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_merges' on node Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo3) SELECT number + 0 AS num, number + 1 + 0 AS foo3 FROM numbers_mt(10) on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo3) SELECT number + 0 AS num, number + 1 + 0 AS foo3 FROM numbers_mt(10) on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo3 % 1000 > 0 on node2 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo3 % 1000 > 0 on node2 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node3 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node3 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_merges' on node Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo2 % 1000 > 0 on node1 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE foo2 % 1000 > 0 on node1 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node3 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node3 run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stderr: Container roottests3lowcardinalityrightborder-gw7-resolver-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw7-resolver-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw7-node1-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw7-node1-1 Stopping Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo2) SELECT number + 0 AS num, number + 1 + 0 AS foo2 FROM numbers_mt(10) on node3 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo2) SELECT number + 0 AS num, number + 1 + 0 AS foo2 FROM numbers_mt(10) on node3 Stderr: Container roottests3lowcardinalityrightborder-gw7-resolver-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw7-resolver-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw7-resolver-1 Removing Stderr: Container roottests3lowcardinalityrightborder-gw7-resolver-1 Removing Stderr: Container roottests3lowcardinalityrightborder-gw7-node1-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw7-node1-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw7-node1-1 Removing Stderr: Container roottests3lowcardinalityrightborder-gw7-node1-1 Removing Stderr: Container roottests3lowcardinalityrightborder-gw7-resolver-1 Removed Stderr: Container roottests3lowcardinalityrightborder-gw7-resolver-1 Removed Stderr: Container roottests3lowcardinalityrightborder-gw7-node1-1 Removed Stderr: Container roottests3lowcardinalityrightborder-gw7-node1-1 Removed Stderr: Container roottests3lowcardinalityrightborder-gw7-minio1-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw7-minio1-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw7-minio1-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw7-minio1-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw7-minio1-1 Removing Stderr: Container roottests3lowcardinalityrightborder-gw7-minio1-1 Removing Stderr: Container roottests3lowcardinalityrightborder-gw7-minio1-1 Removed Stderr: Container roottests3lowcardinalityrightborder-gw7-minio1-1 Removed Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy1-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy1-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy2-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy2-1 Stopping Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy2-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy2-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy2-1 Removing Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy2-1 Removing Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy1-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy1-1 Stopped Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy1-1 Removing Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy1-1 Removing Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy2-1 Removed Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy2-1 Removed Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy1-1 Removed Stderr: Container roottests3lowcardinalityrightborder-gw7-proxy1-1 Removed Stderr: Volume roottests3lowcardinalityrightborder-gw7_data1-1 Removing Stderr: Volume roottests3lowcardinalityrightborder-gw7_data1-1 Removing Stderr: Network roottests3lowcardinalityrightborder-gw7_default Removing Stderr: Network roottests3lowcardinalityrightborder-gw7_default Removing Stderr: Volume roottests3lowcardinalityrightborder-gw7_data1-1 Removed Stderr: Volume roottests3lowcardinalityrightborder-gw7_data1-1 Removed Stderr: Network roottests3lowcardinalityrightborder-gw7_default Removed Stderr: Network roottests3lowcardinalityrightborder-gw7_default Removed Cleanup called Cleanup called Docker networks for project roottests3lowcardinalityrightborder-gw7 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3lowcardinalityrightborder-gw7 are NETWORK ID NAME DRIVER SCOPE Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_merges' on node Stdout:3879 Stdout:3879 Clickhouse process running. Clickhouse process running. run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Docker containers for project roottests3lowcardinalityrightborder-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3lowcardinalityrightborder-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3lowcardinalityrightborder-gw7 are DRIVER VOLUME NAME Docker volumes for project roottests3lowcardinalityrightborder-gw7 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3lowcardinalityrightborder-gw7-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3lowcardinalityrightborder-gw7-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3lowcardinalityrightborder-gw7 No running containers for project: roottests3lowcardinalityrightborder-gw7 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] run container_id:roottestreloadclientcertificate-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'grep -a "Code: 210." /var/log/clickhouse-server/clickhouse-server.log | wc -l'] run container_id:roottestreloadclientcertificate-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'grep -a "Code: 210." /var/log/clickhouse-server/clickhouse-server.log | wc -l'] Command:[docker exec roottestreloadclientcertificate-gw9-node1-1 bash -c grep -a "Code: 210." /var/log/clickhouse-server/clickhouse-server.log | wc -l] Command:[docker exec roottestreloadclientcertificate-gw9-node1-1 bash -c grep -a "Code: 210." /var/log/clickhouse-server/clickhouse-server.log | wc -l] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Stdout:3879 Stdout:3879 Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Executing query select 20 on node Executing query select 20 on node Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:11 Stdout:11 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 11 Volumes pruned: 11 clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Setup Keeper Setup Keeper Cluster name: project_name:roottestreplicateds3zerocopydroppartition-gw7. Added instance name:node1 tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition-gw7', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottestreplicateds3zerocopydroppartition-gw7. Added instance name:node1 tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition-gw7', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Running tests in /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/test.py Running tests in /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/test.py Cluster start called. is_up=False Cluster start called. is_up=False Stdout:0 Stdout:0 [gw9] PASSED test_reload_client_certificate/test.py::test_correct_cn_cert run container_id:roottestreloadclientcertificate-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/first_client.crt\n /etc/clickhouse-server/config.d/first_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] run container_id:roottestreloadclientcertificate-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/first_client.crt\n /etc/clickhouse-server/config.d/first_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] Command:[docker exec roottestreloadclientcertificate-gw9-node1-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/first_client.crt /etc/clickhouse-server/config.d/first_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] Command:[docker exec roottestreloadclientcertificate-gw9-node1-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/first_client.crt /etc/clickhouse-server/config.d/first_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] test_reload_client_certificate/test.py::test_wrong_cn_cert Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Docker networks for project roottestreplicateds3zerocopydroppartition-gw7 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicateds3zerocopydroppartition-gw7 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicateds3zerocopydroppartition-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicateds3zerocopydroppartition-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicateds3zerocopydroppartition-gw7 are DRIVER VOLUME NAME Docker volumes for project roottestreplicateds3zerocopydroppartition-gw7 are DRIVER VOLUME NAME Cleanup called Cleanup called Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_merges' on node Docker networks for project roottestreplicateds3zerocopydroppartition-gw7 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicateds3zerocopydroppartition-gw7 are NETWORK ID NAME DRIVER SCOPE run container_id:roottestreloadclientcertificate-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] run container_id:roottestreloadclientcertificate-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] Command:[docker exec roottestreloadclientcertificate-gw9-node1-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] Command:[docker exec roottestreloadclientcertificate-gw9-node1-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] Docker containers for project roottestreplicateds3zerocopydroppartition-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicateds3zerocopydroppartition-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicateds3zerocopydroppartition-gw7 are DRIVER VOLUME NAME Docker volumes for project roottestreplicateds3zerocopydroppartition-gw7 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreplicateds3zerocopydroppartition-gw7-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreplicateds3zerocopydroppartition-gw7-.*-1$' --format '{{.ID}}:{{.Names}}'] run container_id:roottestreloadclientcertificate-gw9-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/first_client.crt\n /etc/clickhouse-server/config.d/first_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] run container_id:roottestreloadclientcertificate-gw9-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/first_client.crt\n /etc/clickhouse-server/config.d/first_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] Unstopped containers: {} Unstopped containers: {} Command:[docker exec roottestreloadclientcertificate-gw9-node2-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/first_client.crt /etc/clickhouse-server/config.d/first_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] Command:[docker exec roottestreloadclientcertificate-gw9-node2-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/first_client.crt /etc/clickhouse-server/config.d/first_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] No running containers for project: roottestreplicateds3zerocopydroppartition-gw7 No running containers for project: roottestreplicateds3zerocopydroppartition-gw7 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None run container_id:roottestreloadclientcertificate-gw9-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] run container_id:roottestreloadclientcertificate-gw9-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] Command:[docker exec roottestreloadclientcertificate-gw9-node2-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] Command:[docker exec roottestreloadclientcertificate-gw9-node2-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] Stdout:11 Stdout:11 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 11 Volumes pruned: 11 Setup directory for instance: node1 Setup directory for instance: node1 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/configs/storage_conf.xml'] to /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/node1/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/configs/storage_conf.xml'] to /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/node1/configs/config.d Setup database dir /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/node1/database Setup database dir /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/node1/database Setup logs dir /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/node1/logs Setup logs dir /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/node1/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/.env --project-name roottestreplicateds3zerocopydroppartition-gw7 --file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/.env --project-name roottestreplicateds3zerocopydroppartition-gw7 --file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Executing query insert into prod_data select * from numbers(1e4) on node Executing query insert into prod_data select * from numbers(1e4) on node Stopping zookeeper node: zoo1 Stopping zookeeper node: zoo1 Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo1] Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo1] Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo2) SELECT number + 0 AS num, number + 1 + 0 AS foo2 FROM numbers_mt(10) on node3 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,foo2) SELECT number + 0 AS num, number + 1 + 0 AS foo2 FROM numbers_mt(10) on node3 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query select 20 on node Executing query select 20 on node Executing query insert into prod_data select * from numbers(2e4) on node Executing query insert into prod_data select * from numbers(2e4) on node Starting zookeeper node: zoo2 Starting zookeeper node: zoo2 Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo2] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo2] Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query insert into prod_data select * from numbers(3e4) on node Executing query insert into prod_data select * from numbers(3e4) on node Executing query select 20 on node Executing query select 20 on node Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Stopped Stopping zookeeper node: zoo2 Stopping zookeeper node: zoo2 Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo2] Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo2] Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Started Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Started Starting zookeeper node: zoo3 Starting zookeeper node: zoo3 Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo3] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo3] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None Executing query insert into dev_data select * from numbers(1e4) on node Executing query insert into dev_data select * from numbers(1e4) on node Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Started Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Started get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.5.2, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.5.2, port:2181, use_ssl:False Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query insert into dev_data select * from numbers(2e4) on node Executing query insert into dev_data select * from numbers(2e4) on node Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query select 20 on node Executing query select 20 on node Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Stopped Stopping zookeeper node: zoo3 Stopping zookeeper node: zoo3 Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo3] Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo3] Executing query insert into dev_data select * from numbers(3e4) on node Executing query insert into dev_data select * from numbers(3e4) on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query optimize table prod_data final on node Executing query optimize table prod_data final on node Executing query select 20 on node Executing query select 20 on node Executing query optimize table dev_data final on node Executing query optimize table dev_data final on node Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Stopped Starting zookeeper node: zoo1 Starting zookeeper node: zoo1 Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo1] Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo1] Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); on node Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_merges' on node [gw4] PASSED test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/data/proxy_list_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV', 'key String, value String') VALUES ('color','red'),('size','10') on proxy_list_node_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/data/proxy_list_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV', 'key String, value String') VALUES ('color','red'),('size','10') on proxy_list_node_no_proxy Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Started Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Started Starting zookeeper node: zoo2 Starting zookeeper node: zoo2 Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo2] Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo2] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/no_such_option/max_background_jobs/g' /etc/clickhouse-server/config.d/rocksdb.xml"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/no_such_option/max_background_jobs/g' /etc/clickhouse-server/config.d/rocksdb.xml"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c sed -i 's/no_such_option/max_background_jobs/g' /etc/clickhouse-server/config.d/rocksdb.xml] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c sed -i 's/no_such_option/max_background_jobs/g' /etc/clickhouse-server/config.d/rocksdb.xml] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c ps -C clickhouse] Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_merges' on node Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 3879 ? 00:00:04 clickhouse Stdout: 3879 ? 00:00:04 clickhouse run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c pkill clickhouse] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:3879 Stdout:3879 Executing query SELECT * FROM s3('http://minio1:9001/root/data/proxy_list_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on proxy_list_node_no_proxy Executing query SELECT * FROM s3('http://minio1:9001/root/data/proxy_list_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on proxy_list_node_no_proxy Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_merges' on node Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Started Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Started Starting zookeeper node: zoo3 Starting zookeeper node: zoo3 Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo3] Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo3] Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_merges' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_merges' on node Executing query SELECT * FROM s3('http://minio1:9001/root/data/proxy_list_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on proxy_list_node_no_proxy Executing query SELECT * FROM s3('http://minio1:9001/root/data/proxy_list_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on proxy_list_node_no_proxy Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Started Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Started get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.9.2, port:2281, use_ssl:True get_kazoo_client: zoo1, ip:172.16.9.2, port:2281, use_ssl:True Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo2 to foo3 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo2 to foo3 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node [gw1] PASSED test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Stdout:3879 Stdout:3879 Executing query system reload config on node Executing query system reload config on node Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3'; on node Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3'; on node Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query insert into data select * from numbers(1e4) on node Executing query insert into data select * from numbers(1e4) on node Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance [gw0] PASSED test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None Executing query optimize table data final on node Executing query optimize table data final on node run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Stdout:3879 Stdout:3879 Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Connection dropped: socket connection broken Connection dropped: socket connection broken Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/sys/mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/sys/mutations' on node test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables Executing query INSERT INTO `postgres_database`.postgresql_replica_0 SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_0 SELECT number, number from numbers(50) on instance Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/sys/mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/sys/mutations' on node Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['zookeeper', 'clickhouse'] Received response(xid=1): ['zookeeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() Closing connection to 172.16.9.2:2281 Closing connection to 172.16.9.2:2281 Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.9.3, port:2281, use_ssl:True get_kazoo_client: zoo2, ip:172.16.9.3, port:2281, use_ssl:True Executing query INSERT INTO `postgres_database`.postgresql_replica_1 SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_1 SELECT number, number from numbers(50) on instance Connecting to 172.16.9.3(172.16.9.3):2281, use_ssl: True Connecting to 172.16.9.3(172.16.9.3):2281, use_ssl: True Executing query alter table data update key = 1 where key = 42 on node Executing query alter table data update key = 1 where key = 42 on node Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['zookeeper', 'clickhouse'] Received response(xid=1): ['zookeeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() Closing connection to 172.16.9.3:2281 Closing connection to 172.16.9.3:2281 Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.9.4, port:2281, use_ssl:True get_kazoo_client: zoo3, ip:172.16.9.4, port:2281, use_ssl:True Connecting to 172.16.9.4(172.16.9.4):2281, use_ssl: True Connecting to 172.16.9.4(172.16.9.4):2281, use_ssl: True Executing query INSERT INTO `postgres_database`.postgresql_replica_2 SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_2 SELECT number, number from numbers(50) on instance Executing query optimize table data final on node Executing query optimize table data final on node run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:3879 Stdout:3879 Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/sys/mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/sys/mutations' on node Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query INSERT INTO `postgres_database`.postgresql_replica_3 SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_3 SELECT number, number from numbers(50) on instance Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/sys/mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/sys/mutations' on node Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Executing query INSERT INTO `postgres_database`.postgresql_replica_4 SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_4 SELECT number, number from numbers(50) on instance Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['zookeeper', 'clickhouse'] Received response(xid=1): ['zookeeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() Closing connection to 172.16.9.4:2281 Closing connection to 172.16.9.4:2281 Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ['zoo1', 'zoo2', 'zoo3'] All instances of ZooKeeper started: ['zoo1', 'zoo2', 'zoo3'] run container_id:roottestreloadclientcertificate-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] run container_id:roottestreloadclientcertificate-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] Command:[docker exec roottestreloadclientcertificate-gw9-node1-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] Command:[docker exec roottestreloadclientcertificate-gw9-node1-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] run container_id:roottestreloadclientcertificate-gw9-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] run container_id:roottestreloadclientcertificate-gw9-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] Command:[docker exec roottestreloadclientcertificate-gw9-node2-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] Command:[docker exec roottestreloadclientcertificate-gw9-node2-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] run container_id:roottestreloadclientcertificate-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/second_client.crt\n /etc/clickhouse-server/config.d/second_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] run container_id:roottestreloadclientcertificate-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/second_client.crt\n /etc/clickhouse-server/config.d/second_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] Command:[docker exec roottestreloadclientcertificate-gw9-node1-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/second_client.crt /etc/clickhouse-server/config.d/second_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] Command:[docker exec roottestreloadclientcertificate-gw9-node1-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/second_client.crt /etc/clickhouse-server/config.d/second_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 run container_id:roottestreloadclientcertificate-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] run container_id:roottestreloadclientcertificate-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] Command:[docker exec roottestreloadclientcertificate-gw9-node1-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] Command:[docker exec roottestreloadclientcertificate-gw9-node1-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] [gw1] PASSED test_scheduler/test.py::test_mutate_workload Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node test_scheduler/test.py::test_mutation_workload_change run container_id:roottestreloadclientcertificate-gw9-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/second_client.crt\n /etc/clickhouse-server/config.d/second_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] run container_id:roottestreloadclientcertificate-gw9-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF\n\n \n \n /etc/clickhouse-server/config.d/second_client.crt\n /etc/clickhouse-server/config.d/second_client.key\n true\n true\n sslv2,sslv3\n true\n none\n \n RejectCertificateHandler\n \n \n \n\nEOF'] Command:[docker exec roottestreloadclientcertificate-gw9-node2-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/second_client.crt /etc/clickhouse-server/config.d/second_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] Command:[docker exec roottestreloadclientcertificate-gw9-node2-1 bash -c cat > /etc/clickhouse-server/config.d/ssl_conf.xml << EOF /etc/clickhouse-server/config.d/second_client.crt /etc/clickhouse-server/config.d/second_client.key true true sslv2,sslv3 true none RejectCertificateHandler EOF] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None run container_id:roottestreloadclientcertificate-gw9-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] run container_id:roottestreloadclientcertificate-gw9-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'touch /etc/clickhouse-server/config.d/ssl_conf.xml'] Command:[docker exec roottestreloadclientcertificate-gw9-node2-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] Command:[docker exec roottestreloadclientcertificate-gw9-node2-1 bash -c touch /etc/clickhouse-server/config.d/ssl_conf.xml] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Stdout:3879 Stdout:3879 Executing query system reload config on node Executing query system reload config on node Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3'; on node Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3'; on node Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo 'prod_mutations' > /etc/clickhouse-server/config.d/workloads.xml"] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo 'prod_mutations' > /etc/clickhouse-server/config.d/workloads.xml"] Command:[docker exec roottestscheduler-gw1-node-1 bash -c echo 'prod_mutations' > /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c echo 'prod_mutations' > /etc/clickhouse-server/config.d/workloads.xml] Executing query system reload config on node Executing query system reload config on node run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:3879 Stdout:3879 Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query insert into data select * from numbers(1e4) on node Executing query insert into data select * from numbers(1e4) on node Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query optimize table data final on node Executing query optimize table data final on node Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo2 to foo3 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo2 to foo3 on node1 Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_mutations' on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw5-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw5-node-1/exec HTTP/1.1" 201 74 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 http://localhost:None "POST /v1.46/exec/79bbc27e203b5cbb41daf3e21a5e02f9ff6c789761dcec4cc643bceded219c6e/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/79bbc27e203b5cbb41daf3e21a5e02f9ff6c789761dcec4cc643bceded219c6e/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/79bbc27e203b5cbb41daf3e21a5e02f9ff6c789761dcec4cc643bceded219c6e/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/79bbc27e203b5cbb41daf3e21a5e02f9ff6c789761dcec4cc643bceded219c6e/json HTTP/1.1" 200 586 Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_mutations' on node Executing query select * from `postgres_database`.`postgresql_replica_1` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_1` order by key; on instance Executing query alter table data update key = 1 where key = 42 on node Executing query alter table data update key = 1 where key = 42 on node Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query select * from `test_database`.`postgresql_replica_1` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_1` order by key; on instance http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Executing query optimize table data final on node Executing query optimize table data final on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_mutations' on node Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['clickhouse', 'keeper'] Received response(xid=1): ['clickhouse', 'keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.5.3, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.5.3, port:2181, use_ssl:False Connecting to 172.16.5.3(172.16.5.3):2181, use_ssl: False Connecting to 172.16.5.3(172.16.5.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['clickhouse', 'keeper'] Received response(xid=1): ['clickhouse', 'keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Stderr: zoo1 Skipped - Image is already being pulled by node1 Stderr: zoo1 Skipped - Image is already being pulled by node1 Stderr: zoo2 Skipped - Image is already being pulled by node1 Stderr: zoo2 Skipped - Image is already being pulled by node1 Stderr: zoo3 Skipped - Image is already being pulled by node1 Stderr: zoo3 Skipped - Image is already being pulled by node1 Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: minio1 Pulling Stderr: minio1 Pulling Stderr: resolver Pulling Stderr: resolver Pulling Stderr: proxy1 Pulling Stderr: proxy1 Pulling Stderr: node1 Pulling Stderr: node1 Pulling Stderr: minio1 Pulled Stderr: minio1 Pulled Stderr: resolver Pulled Stderr: resolver Pulled Stderr: node1 Pulled Stderr: node1 Pulled Stderr: proxy1 Pulled Stderr: proxy1 Pulled Setup ZooKeeper Setup ZooKeeper Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper1/log', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper1/config', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper1/coordination', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper2/log', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper2/config', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper2/coordination', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper3/log', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper3/config', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper3/coordination'] Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper1/log', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper1/config', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper1/coordination', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper2/log', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper2/config', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper2/coordination', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper3/log', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper3/config', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/keeper3/coordination'] Command:[docker compose --project-name roottestreplicateds3zerocopydroppartition-gw7 --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Command:[docker compose --project-name roottestreplicateds3zerocopydroppartition-gw7 --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ['zoo2', 'zoo3'] All instances of ZooKeeper started: ['zoo2', 'zoo3'] Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2', 'f3'] ORDER BY name on node2 Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2', 'f3'] ORDER BY name on node2 Stdout:4691 Stdout:4691 Clickhouse process running. Clickhouse process running. run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:4691 Stdout:4691 Executing query select 20 on node Executing query select 20 on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_mutations' on node Executing query select * from `postgres_database`.`postgresql_replica_2` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_2` order by key; on instance Executing query CREATE FUNCTION f3 AS (x, y) -> x * y on node1 Executing query CREATE FUNCTION f3 AS (x, y) -> x * y on node1 run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo 'dev_mutations' > /etc/clickhouse-server/config.d/workloads.xml"] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo 'dev_mutations' > /etc/clickhouse-server/config.d/workloads.xml"] Command:[docker exec roottestscheduler-gw1-node-1 bash -c echo 'dev_mutations' > /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c echo 'dev_mutations' > /etc/clickhouse-server/config.d/workloads.xml] Executing query system reload config on node Executing query system reload config on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None Executing query select * from `test_database`.`postgresql_replica_2` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_2` order by key; on instance Executing query select 20 on node Executing query select 20 on node Executing query insert into data select * from numbers(1e4) on node Executing query insert into data select * from numbers(1e4) on node Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Stderr:time="2025-04-02T02:54:06Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:54:06Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestreplicateds3zerocopydroppartition-gw7_default Creating Stderr: Network roottestreplicateds3zerocopydroppartition-gw7_default Creating Stderr: Network roottestreplicateds3zerocopydroppartition-gw7_default Created Stderr: Network roottestreplicateds3zerocopydroppartition-gw7_default Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo2-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo2-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo3-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo3-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo1-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo1-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo2-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo2-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo1-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo1-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo3-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo3-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo2-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo2-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo3-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo3-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo1-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo1-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo3-1 Started Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo3-1 Started Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo1-1 Started Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo1-1 Started Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo2-1 Started Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo2-1 Started Stderr:time="2025-04-02T02:54:07Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:54:07Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:54:07Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:54:07Z" level=debug msg="otel error" error="" Wait ZooKeeper to start Wait ZooKeeper to start get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw7-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw7-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.8.2, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.8.2, port:2181, use_ssl:False Connecting to 172.16.8.2(172.16.8.2):2181, use_ssl: False Connecting to 172.16.8.2(172.16.8.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.8.2(172.16.8.2):2181, use_ssl: False Connecting to 172.16.8.2(172.16.8.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Connecting to 172.16.8.2(172.16.8.2):2181, use_ssl: False Connecting to 172.16.8.2(172.16.8.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query optimize table data final on node Executing query optimize table data final on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None Executing query select * from `postgres_database`.`postgresql_replica_3` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_3` order by key; on instance Executing query select 20 on node Executing query select 20 on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_mutations' on node Connecting to 172.16.8.2(172.16.8.2):2181, use_ssl: False Connecting to 172.16.8.2(172.16.8.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query select * from `test_database`.`postgresql_replica_3` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_3` order by key; on instance Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_mutations' on node Connecting to 172.16.8.2(172.16.8.2):2181, use_ssl: False Connecting to 172.16.8.2(172.16.8.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query alter table data update key = 1 where key = 42 on node Executing query alter table data update key = 1 where key = 42 on node Executing query select 20 on node Executing query select 20 on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance Executing query optimize table data final on node Executing query optimize table data final on node run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo2\n 2181\n \n 2000\n \n\' > /etc/clickhouse-server/conf.d/zookeeper.xml'] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo2\n 2181\n \n 2000\n \n\' > /etc/clickhouse-server/conf.d/zookeeper.xml'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c echo ' zoo2 2181 2000 ' > /etc/clickhouse-server/conf.d/zookeeper.xml] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c echo ' zoo2 2181 2000 ' > /etc/clickhouse-server/conf.d/zookeeper.xml] Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Executing query SYSTEM RELOAD CONFIG on node1 Executing query SYSTEM RELOAD CONFIG on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None Executing query select * from `postgres_database`.`postgresql_replica_4` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_4` order by key; on instance Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_mutations' on node Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Executing query select * from `test_database`.`postgresql_replica_4` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_4` order by key; on instance run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo2\n 2181\n \n 2000\n \n\' > /etc/clickhouse-server/conf.d/zookeeper.xml'] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo2\n 2181\n \n 2000\n \n\' > /etc/clickhouse-server/conf.d/zookeeper.xml'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c echo ' zoo2 2181 2000 ' > /etc/clickhouse-server/conf.d/zookeeper.xml] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c echo ' zoo2 2181 2000 ' > /etc/clickhouse-server/conf.d/zookeeper.xml] Connecting to 172.16.8.2(172.16.8.2):2181, use_ssl: False Connecting to 172.16.8.2(172.16.8.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query select 20 on node Executing query select 20 on node Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_mutations' on node Executing query SYSTEM RELOAD CONFIG on node2 Executing query SYSTEM RELOAD CONFIG on node2 run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/format_version/no_such_table_block_based_table_options/g' /etc/clickhouse-server/config.d/rocksdb.xml"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/format_version/no_such_table_block_based_table_options/g' /etc/clickhouse-server/config.d/rocksdb.xml"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c sed -i 's/format_version/no_such_table_block_based_table_options/g' /etc/clickhouse-server/config.d/rocksdb.xml] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c sed -i 's/format_version/no_such_table_block_based_table_options/g' /etc/clickhouse-server/config.d/rocksdb.xml] [gw5] PASSED test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options Executing query SELECT count() FROM system.tables WHERE database = 'test_database'; on instance Executing query SELECT count() FROM system.tables WHERE database = 'test_database'; on instance [gw1] PASSED test_scheduler/test.py::test_mutation_workload_change Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node test_scheduler/test.py::test_mutation_workload_override run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c ps -C clickhouse] Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 4691 ? 00:00:05 clickhouse Stdout: 4691 ? 00:00:05 clickhouse run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c pkill clickhouse] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Stdout:4691 Stdout:4691 Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance [gw0] PASSED test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables [gw4] PASSED test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/data/remote_proxy_node/test.csv', 'minio', 'minio123', 'CSV', 'key String, value String') VALUES ('color','red'),('size','10') on remote_proxy_node Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/data/remote_proxy_node/test.csv', 'minio', 'minio123', 'CSV', 'key String, value String') VALUES ('color','red'),('size','10') on remote_proxy_node run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Executing query system reload config on node Executing query system reload config on node Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query SELECT * FROM s3('http://minio1:9001/root/data/remote_proxy_node/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on remote_proxy_node Executing query SELECT * FROM s3('http://minio1:9001/root/data/remote_proxy_node/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on remote_proxy_node Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query drop table if exists prod_data; drop table if exists dev_data; create table prod_data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3', mutation_workload='prod_mutations'; create table dev_data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3', mutation_workload='dev_mutations'; on node Executing query drop table if exists prod_data; drop table if exists dev_data; create table prod_data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3', mutation_workload='prod_mutations'; create table dev_data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3', mutation_workload='dev_mutations'; on node Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query SELECT * FROM s3('http://minio1:9001/root/data/remote_proxy_node/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on remote_proxy_node Executing query SELECT * FROM s3('http://minio1:9001/root/data/remote_proxy_node/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on remote_proxy_node Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query insert into prod_data select * from numbers(1e4) on node Executing query insert into prod_data select * from numbers(1e4) on node Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query INSERT INTO `postgres_database`.postgresql_replica_0 SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_0 SELECT number, number from numbers(50) on instance test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables Stdout:4691 Stdout:4691 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Executing query optimize table prod_data final on node Executing query optimize table prod_data final on node Connecting to 172.16.8.2(172.16.8.2):2181, use_ssl: False Connecting to 172.16.8.2(172.16.8.2):2181, use_ssl: False http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None Executing query INSERT INTO `postgres_database`.postgresql_replica_1 SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_1 SELECT number, number from numbers(50) on instance Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query insert into dev_data select * from numbers(1e4) on node Executing query insert into dev_data select * from numbers(1e4) on node run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['ss', '--resolve', '--tcp', '--no-header', 'state', 'ESTABLISHED', '( dport = 2181 or sport = 2181 )'] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['ss', '--resolve', '--tcp', '--no-header', 'state', 'ESTABLISHED', '( dport = 2181 or sport = 2181 )'] Command:[docker exec -u root --privileged roottestreplicateduserdefinedfunctions-gw2-node1-1 ss --resolve --tcp --no-header state ESTABLISHED ( dport = 2181 or sport = 2181 )] Command:[docker exec -u root --privileged roottestreplicateduserdefinedfunctions-gw2-node1-1 ss --resolve --tcp --no-header state ESTABLISHED ( dport = 2181 or sport = 2181 )] Stdout:0 0 node1:44750 roottestreplicateduserdefinedfunctions-gw2-zoo2-1.roottestreplicateduserdefinedfunctions-gw2_default:2181 Stdout:0 0 node1:44750 roottestreplicateduserdefinedfunctions-gw2-zoo2-1.roottestreplicateduserdefinedfunctions-gw2_default:2181 Executing query CREATE FUNCTION f3 AS (x, y) -> x / y on node1 Executing query CREATE FUNCTION f3 AS (x, y) -> x / y on node1 Executing query optimize table dev_data final on node Executing query optimize table dev_data final on node Executing query INSERT INTO `postgres_database`.postgresql_replica_2 SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_2 SELECT number, number from numbers(50) on instance Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2', 'f3'] ORDER BY name on node2 Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2', 'f3'] ORDER BY name on node2 Executing query INSERT INTO `postgres_database`.postgresql_replica_3 SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_3 SELECT number, number from numbers(50) on instance Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_mutations' on node run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None Stdout:4691 Stdout:4691 Executing query INSERT INTO `postgres_database`.postgresql_replica_4 SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_4 SELECT number, number from numbers(50) on instance Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_mutations' on node Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query INSERT INTO `postgres_database`.postgresql_replica_5 SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_5 SELECT number, number from numbers(50) on instance Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_mutations' on node Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2', 'f3'] ORDER BY name on node2 Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2', 'f3'] ORDER BY name on node2 grep in log called Reloaded certificate (/etc/clickhouse-server/config.d/second_client.crt) grep in log called Reloaded certificate (/etc/clickhouse-server/config.d/second_client.crt) run container_id:roottestreloadclientcertificate-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -a "Reloaded certificate (/etc/clickhouse-server/config.d/second_client.crt)" /var/log/clickhouse-server/clickhouse-server.log* || true'] run container_id:roottestreloadclientcertificate-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -a "Reloaded certificate (/etc/clickhouse-server/config.d/second_client.crt)" /var/log/clickhouse-server/clickhouse-server.log* || true'] Command:[docker exec roottestreloadclientcertificate-gw9-node1-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -a "Reloaded certificate (/etc/clickhouse-server/config.d/second_client.crt)" /var/log/clickhouse-server/clickhouse-server.log* || true] Command:[docker exec roottestreloadclientcertificate-gw9-node1-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -a "Reloaded certificate (/etc/clickhouse-server/config.d/second_client.crt)" /var/log/clickhouse-server/clickhouse-server.log* || true] Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_mutations' on node Stdout:2025.04.02 02:54:04.304163 [ 662 ] {} CertificateReloader: Reloaded certificate (/etc/clickhouse-server/config.d/second_client.crt) and key (/etc/clickhouse-server/config.d/second_client.key). Stdout:2025.04.02 02:54:04.304163 [ 662 ] {} CertificateReloader: Reloaded certificate (/etc/clickhouse-server/config.d/second_client.crt) and key (/etc/clickhouse-server/config.d/second_client.key). grep result 2025.04.02 02:54:04.304163 [ 662 ] {} CertificateReloader: Reloaded certificate (/etc/clickhouse-server/config.d/second_client.crt) and key (/etc/clickhouse-server/config.d/second_client.key). grep result 2025.04.02 02:54:04.304163 [ 662 ] {} CertificateReloader: Reloaded certificate (/etc/clickhouse-server/config.d/second_client.crt) and key (/etc/clickhouse-server/config.d/second_client.key). Stopping zookeeper node: zoo1 Stopping zookeeper node: zoo1 Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo1] Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo1] Executing query INSERT INTO `postgres_database`.postgresql_replica_6 SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_6 SELECT number, number from numbers(50) on instance http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None Executing query alter table prod_data update key = 1 where key = 42 on node Executing query alter table prod_data update key = 1 where key = 42 on node Stdout:4691 Stdout:4691 Executing query INSERT INTO `postgres_database`.postgresql_replica_7 SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_7 SELECT number, number from numbers(50) on instance Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query optimize table prod_data final on node Executing query optimize table prod_data final on node Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2', 'f3'] ORDER BY name on node2 Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2', 'f3'] ORDER BY name on node2 Executing query INSERT INTO `postgres_database`.postgresql_replica_8 SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_8 SELECT number, number from numbers(50) on instance Executing query alter table dev_data update key = 1 where key = 42 on node Executing query alter table dev_data update key = 1 where key = 42 on node Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3'settings keeper_max_retries=3, keeper_retry_max_backoff_ms=500 on node1 Executing query INSERT INTO `postgres_database`.postgresql_replica_9 SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_9 SELECT number, number from numbers(50) on instance Executing query optimize table dev_data final on node Executing query optimize table dev_data final on node Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Stopped Stopping zookeeper node: zoo2 Stopping zookeeper node: zoo2 Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo2] Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo2] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2', 'f3'] ORDER BY name on node2 Executing query SELECT name FROM system.functions WHERE name IN ['f1', 'f2', 'f3'] ORDER BY name on node2 Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Stdout:4691 Stdout:4691 Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/prod_mutations' on node http://localhost:None "POST /v1.46/containers/070e72e940df375dcf562625c9c3cde10cd22e662468382b293978539011663d/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/070e72e940df375dcf562625c9c3cde10cd22e662468382b293978539011663d/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/9a515d6104e04c96c4b5cc8f01c046c529db4774f3fdc633d6001b08c8a89b3b/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/9a515d6104e04c96c4b5cc8f01c046c529db4774f3fdc633d6001b08c8a89b3b/start HTTP/1.1" 101 0 Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') SETTINGS materialized_postgresql_tables_list = 'postgresql_replica_0, postgresql_replica_1, postgresql_replica_2, postgresql_replica_3, postgresql_replica_4' on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') SETTINGS materialized_postgresql_tables_list = 'postgresql_replica_0, postgresql_replica_1, postgresql_replica_2, postgresql_replica_3, postgresql_replica_4' on instance Executing query SELECT f1(12, 3), f2(), f3(12, 3) on node2 Executing query SELECT f1(12, 3), f2(), f3(12, 3) on node2 http://localhost:None "GET /v1.46/exec/9a515d6104e04c96c4b5cc8f01c046c529db4774f3fdc633d6001b08c8a89b3b/json HTTP/1.1" 200 545 http://localhost:None "GET /v1.46/exec/9a515d6104e04c96c4b5cc8f01c046c529db4774f3fdc633d6001b08c8a89b3b/json HTTP/1.1" 200 545 [network] 070e72e940df375dcf562625c9c3cde10cd22e662468382b293978539011663d: ['iptables', '--wait', '-D', 'DOCKER-USER', '-m', 'statistic', '--mode', 'random', '--probability', '0.01', '-p', 'tcp', '-s', '172.16.7.11', '--dport', '2181', '-j', 'REJECT', '--reject-with', 'tcp-reset'] (0): [network] 070e72e940df375dcf562625c9c3cde10cd22e662468382b293978539011663d: ['iptables', '--wait', '-D', 'DOCKER-USER', '-m', 'statistic', '--mode', 'random', '--probability', '0.01', '-p', 'tcp', '-s', '172.16.7.11', '--dport', '2181', '-j', 'REJECT', '--reject-with', 'tcp-reset'] (0): http://localhost:None "POST /v1.46/containers/070e72e940df375dcf562625c9c3cde10cd22e662468382b293978539011663d/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/070e72e940df375dcf562625c9c3cde10cd22e662468382b293978539011663d/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/b66aab12a94250ec15bc19e55fd9ed2499b2f2d436829bb3c49770706d98d6fc/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/b66aab12a94250ec15bc19e55fd9ed2499b2f2d436829bb3c49770706d98d6fc/start HTTP/1.1" 101 0 Connecting to 172.16.8.2(172.16.8.2):2181, use_ssl: False Connecting to 172.16.8.2(172.16.8.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/prod_mutations' on node Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw7-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw7-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.8.4, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.8.4, port:2181, use_ssl:False Connecting to 172.16.8.4(172.16.8.4):2181, use_ssl: False Connecting to 172.16.8.4(172.16.8.4):2181, use_ssl: False http://localhost:None "GET /v1.46/exec/b66aab12a94250ec15bc19e55fd9ed2499b2f2d436829bb3c49770706d98d6fc/json HTTP/1.1" 200 545 http://localhost:None "GET /v1.46/exec/b66aab12a94250ec15bc19e55fd9ed2499b2f2d436829bb3c49770706d98d6fc/json HTTP/1.1" 200 545 [network] 070e72e940df375dcf562625c9c3cde10cd22e662468382b293978539011663d: ['iptables', '--wait', '-D', 'DOCKER-USER', '-m', 'statistic', '--mode', 'random', '--probability', '0.01', '-p', 'tcp', '-d', '172.16.7.11', '--sport', '2181', '-j', 'REJECT', '--reject-with', 'tcp-reset'] (0): Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) [network] 070e72e940df375dcf562625c9c3cde10cd22e662468382b293978539011663d: ['iptables', '--wait', '-D', 'DOCKER-USER', '-m', 'statistic', '--mode', 'random', '--probability', '0.01', '-p', 'tcp', '-d', '172.16.7.11', '--sport', '2181', '-j', 'REJECT', '--reject-with', 'tcp-reset'] (0): run container_id:roottestreplicatedmergetrees3zerocopy-gw6-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'timeout 60 tail -Fn1000000 "/var/log/clickhouse-server/clickhouse-server.log" | grep -Em 1 \'Removing metadata metadata_dropped/default.test_drop_table\''] run container_id:roottestreplicatedmergetrees3zerocopy-gw6-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'timeout 60 tail -Fn1000000 "/var/log/clickhouse-server/clickhouse-server.log" | grep -Em 1 \'Removing metadata metadata_dropped/default.test_drop_table\''] Command:[docker exec roottestreplicatedmergetrees3zerocopy-gw6-node1-1 bash -c timeout 60 tail -Fn1000000 "/var/log/clickhouse-server/clickhouse-server.log" | grep -Em 1 'Removing metadata metadata_dropped/default.test_drop_table'] Command:[docker exec roottestreplicatedmergetrees3zerocopy-gw6-node1-1 bash -c timeout 60 tail -Fn1000000 "/var/log/clickhouse-server/clickhouse-server.log" | grep -Em 1 'Removing metadata metadata_dropped/default.test_drop_table'] Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw7-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw7-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.8.3, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.8.3, port:2181, use_ssl:False Connecting to 172.16.8.3(172.16.8.3):2181, use_ssl: False Connecting to 172.16.8.3(172.16.8.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') Trying to create Minio instance by command docker compose --project-name roottestreplicateds3zerocopydroppartition-gw7 --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Trying to create Minio instance by command docker compose --project-name roottestreplicateds3zerocopydroppartition-gw7 --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Command:[docker compose --project-name roottestreplicateds3zerocopydroppartition-gw7 --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Command:[docker compose --project-name roottestreplicateds3zerocopydroppartition-gw7 --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/fair/dev_mutations' on node Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Stopped Stopping zookeeper node: zoo3 Stopping zookeeper node: zoo3 Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo3] Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml stop zoo3] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['ss', '--resolve', '--tcp', '--no-header', 'state', 'ESTABLISHED', '( dport = 2181 or sport = 2181 )'] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['ss', '--resolve', '--tcp', '--no-header', 'state', 'ESTABLISHED', '( dport = 2181 or sport = 2181 )'] Command:[docker exec -u root --privileged roottestreplicateduserdefinedfunctions-gw2-node1-1 ss --resolve --tcp --no-header state ESTABLISHED ( dport = 2181 or sport = 2181 )] Command:[docker exec -u root --privileged roottestreplicateduserdefinedfunctions-gw2-node1-1 ss --resolve --tcp --no-header state ESTABLISHED ( dport = 2181 or sport = 2181 )] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:0 0 node1:44750 roottestreplicateduserdefinedfunctions-gw2-zoo2-1.roottestreplicateduserdefinedfunctions-gw2_default:2181 Stdout:0 0 node1:44750 roottestreplicateduserdefinedfunctions-gw2-zoo2-1.roottestreplicateduserdefinedfunctions-gw2_default:2181 Executing query DROP FUNCTION f1 on node1 Executing query DROP FUNCTION f1 on node1 run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw5-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw5-node-1/exec HTTP/1.1" 201 74 Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_mutations' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/fair/dev_mutations' on node Executing query DROP FUNCTION f2 on node1 Executing query DROP FUNCTION f2 on node1 http://localhost:None "POST /v1.46/exec/75dc3c1653e446d28dcd0b5c354f612d4c5265e465929a3c71cddb6995bd0789/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/75dc3c1653e446d28dcd0b5c354f612d4c5265e465929a3c71cddb6995bd0789/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/75dc3c1653e446d28dcd0b5c354f612d4c5265e465929a3c71cddb6995bd0789/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/75dc3c1653e446d28dcd0b5c354f612d4c5265e465929a3c71cddb6995bd0789/json HTTP/1.1" 200 586 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo2 to foo3 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo2 to foo3 on node1 Executing query DROP FUNCTION f3 on node1 Executing query DROP FUNCTION f3 on node1 Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node [gw1] PASSED test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_resource_any_disk Starting zookeeper node: zoo1 Starting zookeeper node: zoo1 Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo1] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo1] Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Stopped Starting zookeeper node: zoo1 Starting zookeeper node: zoo1 Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo1] Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo1] Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Stdout:2025.04.02 02:54:16.175777 [ 673 ] {} DatabaseCatalog: Removing metadata metadata_dropped/default.test_drop_table.8d381bd1-acc8-4b79-9273-e793e9ed5002.sql of dropped table default.test_drop_table (8d381bd1-acc8-4b79-9273-e793e9ed5002) Stdout:2025.04.02 02:54:16.175777 [ 673 ] {} DatabaseCatalog: Removing metadata metadata_dropped/default.test_drop_table.8d381bd1-acc8-4b79-9273-e793e9ed5002.sql of dropped table default.test_drop_table (8d381bd1-acc8-4b79-9273-e793e9ed5002) 1 log line(s) matching "Removing metadata metadata_dropped/default.test_drop_table" appeared in a 1.437 seconds 1 log line(s) matching "Removing metadata metadata_dropped/default.test_drop_table" appeared in a 1.437 seconds Executing query select name from system.zookeeper where path='/test/drop_table/replicas' on node1 Executing query select name from system.zookeeper where path='/test/drop_table/replicas' on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN num2 to foo2 on node1 run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Executing query system reload config on node Executing query system reload config on node Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3' on node1 Executing query create table if not exists test_drop_table (n int) engine=ReplicatedMergeTree('/test/drop_table', '1') order by n partition by n % 99 settings storage_policy='s3' on node1 Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:5489 Stdout:5489 Clickhouse process running. Clickhouse process running. run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:5489 Stdout:5489 Executing query select 20 on node Executing query select 20 on node Stderr:time="2025-04-02T02:54:15Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:54:15Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Volume "roottestreplicateds3zerocopydroppartition-gw7_data1-1" Creating Stderr: Volume "roottestreplicateds3zerocopydroppartition-gw7_data1-1" Creating Stderr: Volume "roottestreplicateds3zerocopydroppartition-gw7_data1-1" Created Stderr: Volume "roottestreplicateds3zerocopydroppartition-gw7_data1-1" Created Stderr:time="2025-04-02T02:54:15Z" level=warning msg="Found orphan containers ([roottestreplicateds3zerocopydroppartition-gw7-zoo2-1 roottestreplicateds3zerocopydroppartition-gw7-zoo3-1 roottestreplicateds3zerocopydroppartition-gw7-zoo1-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up." Stderr:time="2025-04-02T02:54:15Z" level=warning msg="Found orphan containers ([roottestreplicateds3zerocopydroppartition-gw7-zoo2-1 roottestreplicateds3zerocopydroppartition-gw7-zoo3-1 roottestreplicateds3zerocopydroppartition-gw7-zoo1-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up." Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy2-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy2-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy1-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy1-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy2-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy2-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy1-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy1-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-minio1-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-minio1-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-resolver-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-resolver-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-resolver-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-resolver-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-minio1-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-minio1-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy2-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy2-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy1-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy1-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy2-1 Started Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy2-1 Started Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy1-1 Started Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy1-1 Started Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-minio1-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-minio1-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-resolver-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-resolver-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-minio1-1 Started Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-minio1-1 Started Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-resolver-1 Started Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-resolver-1 Started Stderr:time="2025-04-02T02:54:16Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:54:16Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:54:16Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:54:16Z" level=debug msg="otel error" error="" Trying to connect to Minio... Trying to connect to Minio... get_instance_ip instance_name=minio1 get_instance_ip instance_name=minio1 http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw7-minio1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw7-minio1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy1 get_instance_ip instance_name=proxy1 http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw7-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw7-proxy1-1/json HTTP/1.1" 200 None Starting new HTTP connection (1): 172.16.8.7:9001 Starting new HTTP connection (1): 172.16.8.7:9001 Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (2): 172.16.8.7:9001 Starting new HTTP connection (2): 172.16.8.7:9001 Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (3): 172.16.8.7:9001 Starting new HTTP connection (3): 172.16.8.7:9001 Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (4): 172.16.8.7:9001 Starting new HTTP connection (4): 172.16.8.7:9001 Can't connect to Minio: HTTPConnectionPool(host='172.16.8.7', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Can't connect to Minio: HTTPConnectionPool(host='172.16.8.7', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Started Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Started Starting zookeeper node: zoo2 Starting zookeeper node: zoo2 Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo2] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo2] Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Started Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Started Starting zookeeper node: zoo2 Starting zookeeper node: zoo2 Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo2] Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo2] Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Starting zookeeper node: zoo3 Starting zookeeper node: zoo3 Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo3] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo3] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo1\n 2181\n \n \n zoo2\n 2181\n \n \n zoo3\n 2181\n \n 20000\n \n\n\' > /etc/clickhouse-server/conf.d/zookeeper.xml'] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo1\n 2181\n \n \n zoo2\n 2181\n \n \n zoo3\n 2181\n \n 20000\n \n\n\' > /etc/clickhouse-server/conf.d/zookeeper.xml'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c echo ' zoo1 2181 zoo2 2181 zoo3 2181 20000 ' > /etc/clickhouse-server/conf.d/zookeeper.xml] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c echo ' zoo1 2181 zoo2 2181 zoo3 2181 20000 ' > /etc/clickhouse-server/conf.d/zookeeper.xml] Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None Executing query SYSTEM RELOAD CONFIG on node1 Executing query SYSTEM RELOAD CONFIG on node1 Executing query select 20 on node Executing query select 20 on node Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3_no_resource'; on node Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3_no_resource'; on node Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Executing query detach table test_drop_table sync on node1 Executing query detach table test_drop_table sync on node1 Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Started Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Started Starting zookeeper node: zoo3 Starting zookeeper node: zoo3 Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo3] Command:[docker compose --project-name roottestreloadclientcertificate-gw9 --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml start zoo3] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo1\n 2181\n \n \n zoo2\n 2181\n \n \n zoo3\n 2181\n \n 20000\n \n\n\' > /etc/clickhouse-server/conf.d/zookeeper.xml'] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo1\n 2181\n \n \n zoo2\n 2181\n \n \n zoo3\n 2181\n \n 20000\n \n\n\' > /etc/clickhouse-server/conf.d/zookeeper.xml'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c echo ' zoo1 2181 zoo2 2181 zoo3 2181 20000 ' > /etc/clickhouse-server/conf.d/zookeeper.xml] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c echo ' zoo1 2181 zoo2 2181 zoo3 2181 20000 ' > /etc/clickhouse-server/conf.d/zookeeper.xml] Starting new HTTP connection (5): 172.16.8.7:9001 Starting new HTTP connection (5): 172.16.8.7:9001 http://172.16.8.7:9001 "GET / HTTP/1.1" 200 0 http://172.16.8.7:9001 "GET / HTTP/1.1" 200 0 Connected to Minio. Connected to Minio. Executing query create resource io (write any disk, read any disk); create workload all settings max_cost = 1000000; on node http://172.16.8.7:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.8.7:9001 "GET /root?location= HTTP/1.1" 404 0 Executing query create resource io (write any disk, read any disk); create workload all settings max_cost = 1000000; on node http://172.16.8.7:9001 "PUT /root HTTP/1.1" 200 0 http://172.16.8.7:9001 "PUT /root HTTP/1.1" 200 0 S3 bucket 'root' created S3 bucket 'root' created http://172.16.8.7:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.8.7:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.8.7:9001 "PUT /root2 HTTP/1.1" 200 0 http://172.16.8.7:9001 "PUT /root2 HTTP/1.1" 200 0 S3 bucket 'root2' created S3 bucket 'root2' created ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/.env --project-name roottestreplicateds3zerocopydroppartition-gw7 --file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/.env --project-name roottestreplicateds3zerocopydroppartition-gw7 --file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/.env --project-name roottestreplicateds3zerocopydroppartition-gw7 --file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/.env --project-name roottestreplicateds3zerocopydroppartition-gw7 --file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Executing query SYSTEM RELOAD CONFIG on node2 Executing query SYSTEM RELOAD CONFIG on node2 Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance Executing query select 20 on node Executing query select 20 on node Executing query insert into data select * from numbers(1e5) settings workload='all' on node Executing query insert into data select * from numbers(1e5) settings workload='all' on node Executing query attach table test_drop_table on node1 Executing query attach table test_drop_table on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Starting Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Started Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Started run container_id:roottestreloadclientcertificate-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] run container_id:roottestreloadclientcertificate-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] Command:[docker exec roottestreloadclientcertificate-gw9-node1-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] Command:[docker exec roottestreloadclientcertificate-gw9-node1-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] [gw2] PASSED test_replicated_user_defined_functions/test.py::test_reload_zookeeper test_replicated_user_defined_functions/test.py::test_replication Executing query CREATE FUNCTION f2 AS (x, y) -> x - y on node1 Executing query CREATE FUNCTION f2 AS (x, y) -> x - y on node1 run container_id:roottestreloadclientcertificate-gw9-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] run container_id:roottestreloadclientcertificate-gw9-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo -n > /var/log/clickhouse-server/clickhouse-server.log'] Command:[docker exec roottestreloadclientcertificate-gw9-node2-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] Command:[docker exec roottestreloadclientcertificate-gw9-node2-1 bash -c echo -n > /var/log/clickhouse-server/clickhouse-server.log] get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.9.2, port:2281, use_ssl:True get_kazoo_client: zoo1, ip:172.16.9.2, port:2281, use_ssl:True Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query select dequeued_requests>0 from system.scheduler where resource='io' and path ilike '%/all/%' and type='fifo' on node Executing query select dequeued_requests>0 from system.scheduler where resource='io' and path ilike '%/all/%' and type='fifo' on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query system sync replica test_drop_table on node1 Executing query system sync replica test_drop_table on node1 Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy2-1 Running Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy2-1 Running Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo1-1 Running Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo1-1 Running Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo2-1 Running Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo2-1 Running Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo3-1 Running Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo3-1 Running Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy1-1 Running Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy1-1 Running Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-minio1-1 Running Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-minio1-1 Running Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-node1-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-node1-1 Creating Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-resolver-1 Running Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-resolver-1 Running Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-node1-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-node1-1 Created Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-node1-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-node1-1 Starting Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-node1-1 Started Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-node1-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw7-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw7-node1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw7-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw7-node1-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node1, ip: 172.16.8.9... Waiting for ClickHouse start in node1, ip: 172.16.8.9... http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw7-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateds3zerocopydroppartition-gw7-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query select 20 on node Executing query select 20 on node Executing query CREATE FUNCTION f3 AS () -> (SELECT sum(s) FROM (SELECT 1 as s UNION ALL SELECT 1 as s)) on node1 Executing query CREATE FUNCTION f3 AS () -> (SELECT sum(s) FROM (SELECT 1 as s UNION ALL SELECT 1 as s)) on node1 http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Executing query select sum(key*key) from data settings workload='all' on node Executing query select sum(key*key) from data settings workload='all' on node Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None Executing query SELECT create_query FROM system.functions WHERE name='f2' on node1 Executing query SELECT create_query FROM system.functions WHERE name='f2' on node1 http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query select dequeued_requests>0 from system.scheduler where resource='io' and path ilike '%/all/%' and type='fifo' on node Executing query select dequeued_requests>0 from system.scheduler where resource='io' and path ilike '%/all/%' and type='fifo' on node http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query SELECT create_query FROM system.functions WHERE name='f2' on node2 Executing query SELECT create_query FROM system.functions WHERE name='f2' on node2 Executing query select 20 on node Executing query select 20 on node http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None [gw1] PASSED test_scheduler/test.py::test_resource_any_disk test_scheduler/test.py::test_resource_read_and_write Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query SELECT count() FROM system.tables WHERE database = 'test_database'; on instance Executing query SELECT count() FROM system.tables WHERE database = 'test_database'; on instance http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query SELECT f2(12,3) on node1 Executing query SELECT f2(12,3) on node1 http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query SELECT f2(12,3) on node2 Executing query SELECT f2(12,3) on node2 Executing query SHOW TABLES FROM test_database on instance Executing query SHOW TABLES FROM test_database on instance Executing query select 20 on node Executing query select 20 on node http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query system reload config on node Executing query system reload config on node http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.postgresql_replica_0 SELECT 50 + number, 0 from numbers(100) on instance Executing query INSERT INTO postgres_database.postgresql_replica_0 SELECT 50 + number, 0 from numbers(100) on instance http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query SELECT f3() on node1 Executing query SELECT f3() on node1 http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.postgresql_replica_1 SELECT 50 + number, 1 from numbers(100) on instance Executing query INSERT INTO postgres_database.postgresql_replica_1 SELECT 50 + number, 1 from numbers(100) on instance [gw4] PASSED test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/data/remote_proxy_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV', 'key String, value String') VALUES ('color','red'),('size','10') on remote_proxy_node_no_proxy Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/data/remote_proxy_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV', 'key String, value String') VALUES ('color','red'),('size','10') on remote_proxy_node_no_proxy Executing query SELECT f3() on node2 Executing query SELECT f3() on node2 Executing query select 20 on node Executing query select 20 on node http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3_no_resource'; on node Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3_no_resource'; on node http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.postgresql_replica_2 SELECT 50 + number, 2 from numbers(100) on instance Executing query INSERT INTO postgres_database.postgresql_replica_2 SELECT 50 + number, 2 from numbers(100) on instance http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query DROP FUNCTION f2 on node1 Executing query DROP FUNCTION f2 on node1 Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Connection dropped: socket connection broken Connection dropped: socket connection broken http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query create resource io_write (write disk s3_no_resource); create resource io_read (read disk s3_no_resource); create workload all settings max_cost = 1000000; create workload admin in all settings priority = 0; create workload production in all settings priority = 1, weight = 9; create workload development in all settings priority = 1, weight = 1; on node Executing query create resource io_write (write disk s3_no_resource); create resource io_read (read disk s3_no_resource); create workload all settings max_cost = 1000000; create workload admin in all settings priority = 0; create workload production in all settings priority = 1, weight = 9; create workload development in all settings priority = 1, weight = 1; on node Executing query SELECT * FROM s3('http://minio1:9001/root/data/remote_proxy_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on remote_proxy_node_no_proxy Executing query SELECT * FROM s3('http://minio1:9001/root/data/remote_proxy_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on remote_proxy_node_no_proxy http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query DROP FUNCTION f3 on node1 Executing query DROP FUNCTION f3 on node1 Executing query INSERT INTO postgres_database.postgresql_replica_3 SELECT 50 + number, 3 from numbers(100) on instance Executing query INSERT INTO postgres_database.postgresql_replica_3 SELECT 50 + number, 3 from numbers(100) on instance http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query select 20 on node Executing query select 20 on node http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Connecting to 172.16.9.2(172.16.9.2):2281, use_ssl: True Executing query SELECT create_query FROM system.functions WHERE name='f2' on node1 Executing query SELECT create_query FROM system.functions WHERE name='f2' on node1 http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query insert into data select * from numbers(1e5) settings workload='development' on node Executing query insert into data select * from numbers(1e5) settings workload='development' on node http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query insert into data select * from numbers(1e5) settings workload='production' on node Executing query insert into data select * from numbers(1e5) settings workload='production' on node Executing query insert into data select * from numbers(1e5) settings workload='admin' on node Executing query insert into data select * from numbers(1e5) settings workload='admin' on node Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Executing query INSERT INTO postgres_database.postgresql_replica_4 SELECT 50 + number, 4 from numbers(100) on instance Executing query INSERT INTO postgres_database.postgresql_replica_4 SELECT 50 + number, 4 from numbers(100) on instance http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['zookeeper', 'clickhouse'] Received response(xid=1): ['zookeeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query SELECT * FROM s3('http://minio1:9001/root/data/remote_proxy_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on remote_proxy_node_no_proxy Executing query SELECT * FROM s3('http://minio1:9001/root/data/remote_proxy_node_no_proxy/test.csv', 'minio', 'minio123', 'CSV') FORMAT Values on remote_proxy_node_no_proxy Closing connection to 172.16.9.2:2281 Closing connection to 172.16.9.2:2281 Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.9.3, port:2281, use_ssl:True get_kazoo_client: zoo2, ip:172.16.9.3, port:2281, use_ssl:True Connecting to 172.16.9.3(172.16.9.3):2281, use_ssl: True Connecting to 172.16.9.3(172.16.9.3):2281, use_ssl: True Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT create_query FROM system.functions WHERE name='f2' on node2 Executing query SELECT create_query FROM system.functions WHERE name='f2' on node2 http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.postgresql_replica_5 SELECT 50 + number, 5 from numbers(100) on instance Executing query INSERT INTO postgres_database.postgresql_replica_5 SELECT 50 + number, 5 from numbers(100) on instance Executing query select 20 on node Executing query select 20 on node http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query CREATE FUNCTION f2 AS (x, y) -> x - y on node1 Executing query CREATE FUNCTION f2 AS (x, y) -> x - y on node1 [gw2] PASSED test_replicated_user_defined_functions/test.py::test_replication test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation Executing query select dequeued_requests>0 from system.scheduler where resource='io_write' and path ilike '%/admin/%' and type='fifo' on node Executing query select dequeued_requests>0 from system.scheduler where resource='io_write' and path ilike '%/admin/%' and type='fifo' on node http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.postgresql_replica_6 SELECT 50 + number, 6 from numbers(100) on instance Executing query INSERT INTO postgres_database.postgresql_replica_6 SELECT 50 + number, 6 from numbers(100) on instance http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query SELECT create_query FROM system.functions WHERE name='f2' on node2 Executing query SELECT create_query FROM system.functions WHERE name='f2' on node2 http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query select dequeued_requests>0 from system.scheduler where resource='io_write' and path ilike '%/development/%' and type='fifo' on node Executing query select dequeued_requests>0 from system.scheduler where resource='io_write' and path ilike '%/development/%' and type='fifo' on node Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Executing query INSERT INTO postgres_database.postgresql_replica_7 SELECT 50 + number, 7 from numbers(100) on instance Executing query INSERT INTO postgres_database.postgresql_replica_7 SELECT 50 + number, 7 from numbers(100) on instance Executing query select 20 on node Executing query select 20 on node Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['zookeeper', 'clickhouse'] Received response(xid=1): ['zookeeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query drop table test_drop_table sync on node2 Executing query drop table test_drop_table sync on node2 Closing connection to 172.16.9.3:2281 Closing connection to 172.16.9.3:2281 Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadclientcertificate-gw9-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.9.4, port:2281, use_ssl:True get_kazoo_client: zoo3, ip:172.16.9.4, port:2281, use_ssl:True Connecting to 172.16.9.4(172.16.9.4):2281, use_ssl: True Connecting to 172.16.9.4(172.16.9.4):2281, use_ssl: True http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query CREATE OR REPLACE FUNCTION f2 AS (x, y) -> x + y on node2 Executing query CREATE OR REPLACE FUNCTION f2 AS (x, y) -> x + y on node2 http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); on node Executing query select dequeued_requests>0 from system.scheduler where resource='io_write' and path ilike '%/production/%' and type='fifo' on node Executing query select dequeued_requests>0 from system.scheduler where resource='io_write' and path ilike '%/production/%' and type='fifo' on node Executing query INSERT INTO postgres_database.postgresql_replica_8 SELECT 50 + number, 8 from numbers(100) on instance Executing query INSERT INTO postgres_database.postgresql_replica_8 SELECT 50 + number, 8 from numbers(100) on instance http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query SELECT create_query FROM system.functions WHERE name='f2' on node1 Executing query SELECT create_query FROM system.functions WHERE name='f2' on node1 http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query select sum(key*key) from data settings workload='development' on node Executing query select sum(key*key) from data settings workload='development' on node Executing query select sum(key*key) from data settings workload='production' on node Executing query select sum(key*key) from data settings workload='production' on node Executing query select sum(key*key) from data settings workload='admin' on node Executing query select sum(key*key) from data settings workload='admin' on node Executing query INSERT INTO postgres_database.postgresql_replica_9 SELECT 50 + number, 9 from numbers(100) on instance Executing query INSERT INTO postgres_database.postgresql_replica_9 SELECT 50 + number, 9 from numbers(100) on instance http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query DROP FUNCTION f2 on node1 Executing query DROP FUNCTION f2 on node1 http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/no_such_table_block_based_table_options/format_version/g' /etc/clickhouse-server/config.d/rocksdb.xml"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/no_such_table_block_based_table_options/format_version/g' /etc/clickhouse-server/config.d/rocksdb.xml"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c sed -i 's/no_such_table_block_based_table_options/format_version/g' /etc/clickhouse-server/config.d/rocksdb.xml] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c sed -i 's/no_such_table_block_based_table_options/format_version/g' /etc/clickhouse-server/config.d/rocksdb.xml] http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c ps -C clickhouse] Executing query SELECT create_query FROM system.functions WHERE name='f2' on node1 Executing query SELECT create_query FROM system.functions WHERE name='f2' on node1 Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 5489 ? 00:00:05 clickhouse Stdout: 5489 ? 00:00:05 clickhouse run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c pkill clickhouse] http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Executing query SELECT create_query FROM system.functions WHERE name='f2' on node2 Executing query SELECT create_query FROM system.functions WHERE name='f2' on node2 http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Stdout:5489 Stdout:5489 Executing query select count(n), sum(n) from test_drop_table on node1 Executing query select count(n), sum(n) from test_drop_table on node1 http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['zookeeper', 'clickhouse'] Received response(xid=1): ['zookeeper', 'clickhouse'] Sending request(xid=2): Close() Sending request(xid=2): Close() Closing connection to 172.16.9.4:2281 Closing connection to 172.16.9.4:2281 Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ['zoo1', 'zoo2', 'zoo3'] All instances of ZooKeeper started: ['zoo1', 'zoo2', 'zoo3'] Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query SELECT count() FROM system.zookeeper WHERE path = '/' on node1 Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance [gw2] PASSED test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation test_replicated_user_defined_functions/test.py::test_server_restart Executing query CREATE FUNCTION f1 AS () -> (SELECT sum(s) FROM (SELECT 1 as s UNION ALL SELECT 1 as s)) on node1 Executing query CREATE FUNCTION f1 AS () -> (SELECT sum(s) FROM (SELECT 1 as s UNION ALL SELECT 1 as s)) on node1 http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/8725ade77de9feee07e7008f5ad48d8a85309cd95faf6ad4b4c0f365aefb1497/json HTTP/1.1" 200 None ClickHouse node1 started ClickHouse node1 started Executing query CREATE TABLE test_local(c1 Int8, c2 Date) ENGINE = ReplicatedMergeTree('/test/tables/shard/test_local', '1') PARTITION BY c2 ORDER BY c2 on node1 Executing query CREATE TABLE test_local(c1 Int8, c2 Date) ENGINE = ReplicatedMergeTree('/test/tables/shard/test_local', '1') PARTITION BY c2 ORDER BY c2 on node1 Executing query select dequeued_requests>0 from system.scheduler where resource='io_read' and path ilike '%/admin/%' and type='fifo' on node Executing query select dequeued_requests>0 from system.scheduler where resource='io_read' and path ilike '%/admin/%' and type='fifo' on node Executing query SELECT f1() on node1 Executing query SELECT f1() on node1 Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select dequeued_requests>0 from system.scheduler where resource='io_read' and path ilike '%/development/%' and type='fifo' on node Executing query select dequeued_requests>0 from system.scheduler where resource='io_read' and path ilike '%/development/%' and type='fifo' on node Executing query CREATE TABLE test_s3(c1 Int8, c2 Date) ENGINE = ReplicatedMergeTree('/test/tables/shard/test_s3', '1') PARTITION BY c2 ORDER BY c2 SETTINGS storage_policy = 's3', allow_remote_fs_zero_copy_replication=0 on node1 Executing query CREATE TABLE test_s3(c1 Int8, c2 Date) ENGINE = ReplicatedMergeTree('/test/tables/shard/test_s3', '1') PARTITION BY c2 ORDER BY c2 SETTINGS storage_policy = 's3', allow_remote_fs_zero_copy_replication=0 on node1 run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps -C clickhouse] Stdout:5489 Stdout:5489 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 7 ? 00:00:15 clickhouse Stdout: 7 ? 00:00:15 clickhouse run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c pkill clickhouse] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Executing query select dequeued_requests>0 from system.scheduler where resource='io_read' and path ilike '%/production/%' and type='fifo' on node Executing query select dequeued_requests>0 from system.scheduler where resource='io_read' and path ilike '%/production/%' and type='fifo' on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query drop table test_drop_table sync on node1 Executing query drop table test_drop_table sync on node1 Executing query INSERT INTO test_local VALUES (1, '2023-10-04'), (2, '2023-10-04') on node1 Executing query INSERT INTO test_local VALUES (1, '2023-10-04'), (2, '2023-10-04') on node1 Stdout:7 Stdout:7 Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node [gw1] PASSED test_scheduler/test.py::test_resource_read_and_write Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node test_scheduler/test.py::test_s3_disk Executing query SELECT count() FROM test_local on node1 Executing query SELECT count() FROM test_local on node1 run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] http://172.16.8.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 http://172.16.8.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 Executing query ALTER TABLE test_s3 FETCH PARTITION '2023-10-04' FROM '/test/tables/shard/test_local' on node1 Executing query ALTER TABLE test_s3 FETCH PARTITION '2023-10-04' FROM '/test/tables/shard/test_local' on node1 Executing query system reload config on node Executing query system reload config on node Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Stdout:5489 Stdout:5489 Executing query ALTER TABLE test_s3 DROP DETACHED PARTITION '2023-10-04' SETTINGS allow_drop_detached = 1 on node1 Executing query ALTER TABLE test_s3 DROP DETACHED PARTITION '2023-10-04' SETTINGS allow_drop_detached = 1 on node1 Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3'; on node Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3'; on node run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:7 Stdout:7 http://172.16.8.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 http://172.16.8.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 Executing query DROP TABLE test_local SYNC on node1 Executing query DROP TABLE test_local SYNC on node1 Executing query insert into data select * from numbers(1e5) settings workload='development' on node Executing query insert into data select * from numbers(1e5) settings workload='development' on node Executing query insert into data select * from numbers(1e5) settings workload='production' on node Executing query insert into data select * from numbers(1e5) settings workload='production' on node Executing query insert into data select * from numbers(1e5) settings workload='admin' on node Executing query insert into data select * from numbers(1e5) settings workload='admin' on node Executing query DROP TABLE test_s3 SYNC on node1 Executing query DROP TABLE test_s3 SYNC on node1 Executing query select dequeued_requests>0 from system.scheduler where resource='network_write' and path='/prio/admin' on node Executing query select dequeued_requests>0 from system.scheduler where resource='network_write' and path='/prio/admin' on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Stdout:5489 Stdout:5489 [gw7] PASSED test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns Executing query CREATE TABLE warming_up( id Int8 ) ENGINE = MergeTree order by (id) SETTINGS storage_policy = 's3'; on node1 Executing query CREATE TABLE warming_up( id Int8 ) ENGINE = MergeTree order by (id) SETTINGS storage_policy = 's3'; on node1 Executing query select dequeued_requests>0 from system.scheduler where resource='network_write' and path='/prio/fair/dev' on node Executing query select dequeued_requests>0 from system.scheduler where resource='network_write' and path='/prio/fair/dev' on node Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:7 Stdout:7 Executing query select dequeued_requests>0 from system.scheduler where resource='network_write' and path='/prio/fair/prod' on node Executing query select dequeued_requests>0 from system.scheduler where resource='network_write' and path='/prio/fair/prod' on node http://172.16.8.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 http://172.16.8.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 Executing query CREATE TABLE test_s3_complex_types( c1 Int8, c2 Date, `c3.k` Array(String), `c3.v1` Array(Int64), `c3.v3` Array(Int64), `c3.v4` Array(Int64) ) ENGINE = MergeTree order by (c1,c2) SETTINGS storage_policy = 's3', min_bytes_for_wide_part=1, vertical_merge_algorithm_min_rows_to_activate=1, vertical_merge_algorithm_min_columns_to_activate=1; on node1 Executing query CREATE TABLE test_s3_complex_types( c1 Int8, c2 Date, `c3.k` Array(String), `c3.v1` Array(Int64), `c3.v3` Array(Int64), `c3.v4` Array(Int64) ) ENGINE = MergeTree order by (c1,c2) SETTINGS storage_policy = 's3', min_bytes_for_wide_part=1, vertical_merge_algorithm_min_rows_to_activate=1, vertical_merge_algorithm_min_columns_to_activate=1; on node1 Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query insert into test_s3_complex_types values(1,toDate('2020-10-01'), ['a','b'], [1,2], [3,4], [5,6]) on node1 Executing query insert into test_s3_complex_types values(1,toDate('2020-10-01'), ['a','b'], [1,2], [3,4], [5,6]) on node1 Executing query select sum(key*key) from data settings workload='development' on node Executing query select sum(key*key) from data settings workload='development' on node Executing query select sum(key*key) from data settings workload='production' on node Executing query select sum(key*key) from data settings workload='production' on node Executing query select sum(key*key) from data settings workload='admin' on node Executing query select sum(key*key) from data settings workload='admin' on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance Executing query insert into test_s3_complex_types values(1,toDate('2020-10-01'), ['a','b'], [7,8], [9,10], [11,12]) on node1 Executing query insert into test_s3_complex_types values(1,toDate('2020-10-01'), ['a','b'], [7,8], [9,10], [11,12]) on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query select * from `postgres_database`.`postgresql_replica_1` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_1` order by key; on instance run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw5-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw5-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/47b5d4346422316d547281fb6dae5a9532b35612d31d2452e0fe231423a6203f/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/47b5d4346422316d547281fb6dae5a9532b35612d31d2452e0fe231423a6203f/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/47b5d4346422316d547281fb6dae5a9532b35612d31d2452e0fe231423a6203f/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/47b5d4346422316d547281fb6dae5a9532b35612d31d2452e0fe231423a6203f/json HTTP/1.1" 200 586 run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://172.16.8.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 http://172.16.8.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 Executing query optimize table test_s3_complex_types final on node1 Executing query optimize table test_s3_complex_types final on node1 Executing query select dequeued_requests>0 from system.scheduler where resource='network_read' and path='/prio/admin' on node Executing query select dequeued_requests>0 from system.scheduler where resource='network_read' and path='/prio/admin' on node Executing query select * from `test_database`.`postgresql_replica_1` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_1` order by key; on instance Stdout:7 Stdout:7 Executing query select dequeued_requests>0 from system.scheduler where resource='network_read' and path='/prio/fair/dev' on node Executing query select dequeued_requests>0 from system.scheduler where resource='network_read' and path='/prio/fair/dev' on node Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance http://172.16.8.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 http://172.16.8.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 Executing query DROP TABLE test_s3_complex_types SYNC on node1 Executing query DROP TABLE test_s3_complex_types SYNC on node1 http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Executing query select dequeued_requests>0 from system.scheduler where resource='network_read' and path='/prio/fair/prod' on node Executing query select dequeued_requests>0 from system.scheduler where resource='network_read' and path='/prio/fair/prod' on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance http://172.16.8.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 http://172.16.8.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 Executing query DROP TABLE warming_up SYNC on node1 Executing query DROP TABLE warming_up SYNC on node1 [gw6] PASSED test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table Executing query DROP TABLE IF EXISTS s3_test SYNC on node1 Executing query DROP TABLE IF EXISTS s3_test SYNC on node1 run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] [gw1] PASSED test_scheduler/test.py::test_s3_disk test_scheduler/test.py::test_s3_resource_request_granularity Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Stdout:6277 Stdout:6277 Clickhouse process running. Clickhouse process running. run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query select * from `postgres_database`.`postgresql_replica_2` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_2` order by key; on instance Stdout:6277 Stdout:6277 Executing query select 20 on node Executing query select 20 on node run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node1 Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node1 Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/.env --project-name roottestreplicateds3zerocopydroppartition-gw7 --file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/.env --project-name roottestreplicateds3zerocopydroppartition-gw7 --file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] [gw7] PASSED test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node1-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node1-1/exec HTTP/1.1" 201 74 Executing query select * from `test_database`.`postgresql_replica_2` order by key; on instance run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] Executing query select * from `test_database`.`postgresql_replica_2` order by key; on instance run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] http://localhost:None "POST /v1.46/exec/3c91fb3ae6622b450f4c7e7063f58bc41aedfba10ac6c4b95fcf1c3c37109b5f/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/3c91fb3ae6622b450f4c7e7063f58bc41aedfba10ac6c4b95fcf1c3c37109b5f/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/3c91fb3ae6622b450f4c7e7063f58bc41aedfba10ac6c4b95fcf1c3c37109b5f/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/3c91fb3ae6622b450f4c7e7063f58bc41aedfba10ac6c4b95fcf1c3c37109b5f/json HTTP/1.1" 200 586 Executing query DROP TABLE IF EXISTS s3_test SYNC on node2 Executing query DROP TABLE IF EXISTS s3_test SYNC on node2 Executing query system reload config on node Executing query system reload config on node Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node2 Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node2 Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Executing query select 20 on node Executing query select 20 on node Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE), value String CODEC(NONE)) engine=MergeTree() order by key settings min_bytes_for_wide_part=1e9, storage_policy='s3'; on node Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE), value String CODEC(NONE)) engine=MergeTree() order by key settings min_bytes_for_wide_part=1e9, storage_policy='s3'; on node Executing query DROP TABLE IF EXISTS s3_test SYNC on node3 Executing query DROP TABLE IF EXISTS s3_test SYNC on node3 Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/admin' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/admin' on node Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node3 Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node3 Executing query select * from `postgres_database`.`postgresql_replica_3` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_3` order by key; on instance Resetting dropped connection: 172.16.7.7 Resetting dropped connection: 172.16.7.7 http://172.16.7.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 http://172.16.7.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16] Executing query CREATE TABLE s3_test ON CLUSTER cluster ( dt Date, id Int64, data String, INDEX min_max (id) TYPE minmax GRANULARITY 3 ) ENGINE=ReplicatedMergeTree() PARTITION BY dt ORDER BY (dt, id) SETTINGS storage_policy='s3' ,min_rows_for_wide_part=0 on node1 Executing query CREATE TABLE s3_test ON CLUSTER cluster ( dt Date, id Int64, data String, INDEX min_max (id) TYPE minmax GRANULARITY 3 ) ENGINE=ReplicatedMergeTree() PARTITION BY dt ORDER BY (dt, id) SETTINGS storage_policy='s3' ,min_rows_for_wide_part=0 on node1 Executing query select dequeued_cost from system.scheduler where resource='network_write' and path='/prio/admin' on node Executing query select dequeued_cost from system.scheduler where resource='network_write' and path='/prio/admin' on node Executing query select 20 on node Executing query select 20 on node run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query select * from `test_database`.`postgresql_replica_3` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_3` order by key; on instance Stdout:817 Stdout:817 Clickhouse process running. Clickhouse process running. run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:817 Stdout:817 Executing query select 20 on node1 Executing query select 20 on node1 Executing query select budget from system.scheduler where resource='network_write' and path='/prio/admin' on node Executing query select budget from system.scheduler where resource='network_write' and path='/prio/admin' on node http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3tablefunctionwithhttpproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query INSERT INTO s3_test VALUES ('2020-01-01',1,'SCrhHCQXFX'),('2020-01-01',2,'xSqQETTtHQ'),('2020-01-01',3,'tKIoPXAmfS'),('2020-01-01',4,'BhjDvqckoO'),('2020-01-01',5,'YBjfCImLwq'),('2020-01-01',6,'rwOeoQqsrg'),('2020-01-01',7,'PGamkustPs'),('2020-01-01',8,'NHvdECblmd'),('2020-01-01',9,'dvHoGmLNbZ'),('2020-01-01',10,'lYcnVHtVAz'),('2020-01-01',11,'uUDCZkzwCx'),('2020-01-01',12,'vnfByQhmVT'),('2020-01-01',13,'SsFAefxexy'),('2020-01-01',14,'ExbNfjgREf'),('2020-01-01',15,'HbtcMEsCLI'),('2020-01-01',16,'TAEyiIWhDa'),('2020-01-01',17,'awQjIEaysg'),('2020-01-01',18,'bqlSrBQeom'),('2020-01-01',19,'eZAgwXHCfe'),('2020-01-01',20,'ESAqpJvcBZ'),('2020-01-01',21,'rCoYUNNqOo'),('2020-01-01',22,'mQwFxgRHwt'),('2020-01-01',23,'jQARAYbNDE'),('2020-01-01',24,'PcabSdAJrm'),('2020-01-01',25,'pzqoxSYfor'),('2020-01-01',26,'ByDFBNtXlu'),('2020-01-01',27,'fMRVRwOlkD'),('2020-01-01',28,'dKLcumHfZy'),('2020-01-01',29,'WSfwSdMHzT'),('2020-01-01',30,'sjsjjetXXf'),('2020-01-01',31,'TmldiOGqat'),('2020-01-01',32,'irE on node1 Executing query INSERT INTO s3_test VALUES ('2020-01-01',1,'SCrhHCQXFX'),('2020-01-01',2,'xSqQETTtHQ'),('2020-01-01',3,'tKIoPXAmfS'),('2020-01-01',4,'BhjDvqckoO'),('2020-01-01',5,'YBjfCImLwq'),('2020-01-01',6,'rwOeoQqsrg'),('2020-01-01',7,'PGamkustPs'),('2020-01-01',8,'NHvdECblmd'),('2020-01-01',9,'dvHoGmLNbZ'),('2020-01-01',10,'lYcnVHtVAz'),('2020-01-01',11,'uUDCZkzwCx'),('2020-01-01',12,'vnfByQhmVT'),('2020-01-01',13,'SsFAefxexy'),('2020-01-01',14,'ExbNfjgREf'),('2020-01-01',15,'HbtcMEsCLI'),('2020-01-01',16,'TAEyiIWhDa'),('2020-01-01',17,'awQjIEaysg'),('2020-01-01',18,'bqlSrBQeom'),('2020-01-01',19,'eZAgwXHCfe'),('2020-01-01',20,'ESAqpJvcBZ'),('2020-01-01',21,'rCoYUNNqOo'),('2020-01-01',22,'mQwFxgRHwt'),('2020-01-01',23,'jQARAYbNDE'),('2020-01-01',24,'PcabSdAJrm'),('2020-01-01',25,'pzqoxSYfor'),('2020-01-01',26,'ByDFBNtXlu'),('2020-01-01',27,'fMRVRwOlkD'),('2020-01-01',28,'dKLcumHfZy'),('2020-01-01',29,'WSfwSdMHzT'),('2020-01-01',30,'sjsjjetXXf'),('2020-01-01',31,'TmldiOGqat'),('2020-01-01',32,'irE on node1 Executing query insert into data select number, randomString(10000000) from numbers(5) SETTINGS workload='admin' on node Executing query insert into data select number, randomString(10000000) from numbers(5) SETTINGS workload='admin' on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance Executing query select 20 on node Executing query select 20 on node Executing query select 20 on node1 Executing query select 20 on node1 Executing query select * from `postgres_database`.`postgresql_replica_4` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_4` order by key; on instance Executing query INSERT INTO s3_test VALUES ('2020-01-02',1,'NNgdCnXCGV'),('2020-01-02',2,'jbixtmznyQ'),('2020-01-02',3,'HBrSTUcnHh'),('2020-01-02',4,'fnQQaZWoOa'),('2020-01-02',5,'HpoiLqDouV'),('2020-01-02',6,'OdhTdQsqqO'),('2020-01-02',7,'TBhuhhxKmb'),('2020-01-02',8,'qlkCYQpFZK'),('2020-01-02',9,'RnJCBsCnxE'),('2020-01-02',10,'pyWSSURzJe'),('2020-01-02',11,'IkrXacfaQt'),('2020-01-02',12,'UfbaiZOZrO'),('2020-01-02',13,'RLzMztMTkM'),('2020-01-02',14,'qJElUduoot'),('2020-01-02',15,'owBiEdhCGi'),('2020-01-02',16,'GZoQQEoMOh'),('2020-01-02',17,'hUfwipdrJk'),('2020-01-02',18,'WyiOBsWYaW'),('2020-01-02',19,'JesIXLmkEu'),('2020-01-02',20,'UnwGVAlGNV'),('2020-01-02',21,'TuEPHVrePj'),('2020-01-02',22,'HglmJnwZkJ'),('2020-01-02',23,'txXRvHjmBf'),('2020-01-02',24,'CRqRJXoEse'),('2020-01-02',25,'TcMamirkXO'),('2020-01-02',26,'lYbXWQoYLG'),('2020-01-02',27,'cNuoizdcZw'),('2020-01-02',28,'JYjivktJlP'),('2020-01-02',29,'nxMOEQvyEt'),('2020-01-02',30,'AlLxKfDKCG'),('2020-01-02',31,'IJIiePBwHM'),('2020-01-02',32,'yDa on node2 Executing query INSERT INTO s3_test VALUES ('2020-01-02',1,'NNgdCnXCGV'),('2020-01-02',2,'jbixtmznyQ'),('2020-01-02',3,'HBrSTUcnHh'),('2020-01-02',4,'fnQQaZWoOa'),('2020-01-02',5,'HpoiLqDouV'),('2020-01-02',6,'OdhTdQsqqO'),('2020-01-02',7,'TBhuhhxKmb'),('2020-01-02',8,'qlkCYQpFZK'),('2020-01-02',9,'RnJCBsCnxE'),('2020-01-02',10,'pyWSSURzJe'),('2020-01-02',11,'IkrXacfaQt'),('2020-01-02',12,'UfbaiZOZrO'),('2020-01-02',13,'RLzMztMTkM'),('2020-01-02',14,'qJElUduoot'),('2020-01-02',15,'owBiEdhCGi'),('2020-01-02',16,'GZoQQEoMOh'),('2020-01-02',17,'hUfwipdrJk'),('2020-01-02',18,'WyiOBsWYaW'),('2020-01-02',19,'JesIXLmkEu'),('2020-01-02',20,'UnwGVAlGNV'),('2020-01-02',21,'TuEPHVrePj'),('2020-01-02',22,'HglmJnwZkJ'),('2020-01-02',23,'txXRvHjmBf'),('2020-01-02',24,'CRqRJXoEse'),('2020-01-02',25,'TcMamirkXO'),('2020-01-02',26,'lYbXWQoYLG'),('2020-01-02',27,'cNuoizdcZw'),('2020-01-02',28,'JYjivktJlP'),('2020-01-02',29,'nxMOEQvyEt'),('2020-01-02',30,'AlLxKfDKCG'),('2020-01-02',31,'IJIiePBwHM'),('2020-01-02',32,'yDa on node2 Executing query select * from `test_database`.`postgresql_replica_4` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_4` order by key; on instance Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/.env --project-name roottests3tablefunctionwithhttpproxy-gw4 --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node_no_proxy/docker-compose.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/.env --project-name roottests3tablefunctionwithhttpproxy-gw4 --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node_no_proxy/docker-compose.yml stop --timeout 20] [gw4] PASSED test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy Executing query select 20 on node Executing query select 20 on node Executing query select 20 on node1 Executing query select 20 on node1 Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance [gw0] PASSED test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables Executing query INSERT INTO s3_test VALUES ('2020-01-03',1,'nKFAUgrEDO'),('2020-01-03',2,'WZSUKUlvdo'),('2020-01-03',3,'uXVtetVhjo'),('2020-01-03',4,'aVxhJdscAv'),('2020-01-03',5,'hzLMBDmhNF'),('2020-01-03',6,'lIMazoyubr'),('2020-01-03',7,'EfHDOZMRHw'),('2020-01-03',8,'AmoJXZWOkJ'),('2020-01-03',9,'eTHOXFgtZC'),('2020-01-03',10,'sCiZqjlzxd'),('2020-01-03',11,'AMaSQLOWuj'),('2020-01-03',12,'MHoTqkbllX'),('2020-01-03',13,'EsVIiWrnsH'),('2020-01-03',14,'ZvWKFPkkIa'),('2020-01-03',15,'cdkKrvXoIq'),('2020-01-03',16,'uEShybePIN'),('2020-01-03',17,'QvYbSZpXJF'),('2020-01-03',18,'sPxsczFLQH'),('2020-01-03',19,'zvZuXWbCFB'),('2020-01-03',20,'tDtagJQuRr'),('2020-01-03',21,'NbcljjfHYa'),('2020-01-03',22,'BPhZLhAASF'),('2020-01-03',23,'IxLZueiaCt'),('2020-01-03',24,'DOjoYfrble'),('2020-01-03',25,'JcqVKKKCju'),('2020-01-03',26,'IyKFcrlGNp'),('2020-01-03',27,'BOHEoHHVRH'),('2020-01-03',28,'VkbAitpYOM'),('2020-01-03',29,'OpEdHGlFVf'),('2020-01-03',30,'uMurdRMiYt'),('2020-01-03',31,'mUxzZsudKr'),('2020-01-03',32,'PCE on node3 Executing query INSERT INTO s3_test VALUES ('2020-01-03',1,'nKFAUgrEDO'),('2020-01-03',2,'WZSUKUlvdo'),('2020-01-03',3,'uXVtetVhjo'),('2020-01-03',4,'aVxhJdscAv'),('2020-01-03',5,'hzLMBDmhNF'),('2020-01-03',6,'lIMazoyubr'),('2020-01-03',7,'EfHDOZMRHw'),('2020-01-03',8,'AmoJXZWOkJ'),('2020-01-03',9,'eTHOXFgtZC'),('2020-01-03',10,'sCiZqjlzxd'),('2020-01-03',11,'AMaSQLOWuj'),('2020-01-03',12,'MHoTqkbllX'),('2020-01-03',13,'EsVIiWrnsH'),('2020-01-03',14,'ZvWKFPkkIa'),('2020-01-03',15,'cdkKrvXoIq'),('2020-01-03',16,'uEShybePIN'),('2020-01-03',17,'QvYbSZpXJF'),('2020-01-03',18,'sPxsczFLQH'),('2020-01-03',19,'zvZuXWbCFB'),('2020-01-03',20,'tDtagJQuRr'),('2020-01-03',21,'NbcljjfHYa'),('2020-01-03',22,'BPhZLhAASF'),('2020-01-03',23,'IxLZueiaCt'),('2020-01-03',24,'DOjoYfrble'),('2020-01-03',25,'JcqVKKKCju'),('2020-01-03',26,'IyKFcrlGNp'),('2020-01-03',27,'BOHEoHHVRH'),('2020-01-03',28,'VkbAitpYOM'),('2020-01-03',29,'OpEdHGlFVf'),('2020-01-03',30,'uMurdRMiYt'),('2020-01-03',31,'mUxzZsudKr'),('2020-01-03',32,'PCE on node3 [gw5] PASSED test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/max_bytes_for_level_base/no_such_table_column_family_option/g' /etc/clickhouse-server/config.d/rocksdb.xml"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/max_bytes_for_level_base/no_such_table_column_family_option/g' /etc/clickhouse-server/config.d/rocksdb.xml"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c sed -i 's/max_bytes_for_level_base/no_such_table_column_family_option/g' /etc/clickhouse-server/config.d/rocksdb.xml] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c sed -i 's/max_bytes_for_level_base/no_such_table_column_family_option/g' /etc/clickhouse-server/config.d/rocksdb.xml] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c ps -C clickhouse] Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 6277 ? 00:00:04 clickhouse Stdout: 6277 ? 00:00:04 clickhouse run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c pkill clickhouse] Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:6277 Stdout:6277 Executing query select 20 on node1 Executing query select 20 on node1 Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query SELECT * FROM s3_test order by dt, id FORMAT Values on node1 Executing query SELECT * FROM s3_test order by dt, id FORMAT Values on node1 Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/admin' on node Executing query select dequeued_requests from system.scheduler where resource='network_write' and path='/prio/admin' on node test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries Executing query INSERT INTO `postgres_database`.test_many_conc_0 SELECT number, number from numbers(10000) on instance Executing query INSERT INTO `postgres_database`.test_many_conc_0 SELECT number, number from numbers(10000) on instance Executing query SELECT * FROM s3_test order by dt, id FORMAT Values on node2 Executing query SELECT * FROM s3_test order by dt, id FORMAT Values on node2 Executing query select 20 on node1 Executing query select 20 on node1 Executing query select dequeued_cost from system.scheduler where resource='network_write' and path='/prio/admin' on node Executing query select dequeued_cost from system.scheduler where resource='network_write' and path='/prio/admin' on node Executing query INSERT INTO `postgres_database`.test_many_conc_1 SELECT number, number from numbers(10000) on instance Executing query INSERT INTO `postgres_database`.test_many_conc_1 SELECT number, number from numbers(10000) on instance run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:6277 Stdout:6277 Executing query select budget from system.scheduler where resource='network_write' and path='/prio/admin' on node Executing query select budget from system.scheduler where resource='network_write' and path='/prio/admin' on node Executing query SELECT * FROM s3_test order by dt, id FORMAT Values on node3 Executing query SELECT * FROM s3_test order by dt, id FORMAT Values on node3 Executing query INSERT INTO `postgres_database`.test_many_conc_2 SELECT number, number from numbers(10000) on instance Executing query INSERT INTO `postgres_database`.test_many_conc_2 SELECT number, number from numbers(10000) on instance Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query system flush logs on node Executing query system flush logs on node Executing query select 20 on node1 Executing query select 20 on node1 http://172.16.7.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 http://172.16.7.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 [gw6] PASSED test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16] Executing query DROP TABLE IF EXISTS s3_test SYNC on node1 Executing query DROP TABLE IF EXISTS s3_test SYNC on node1 Executing query SELECT f1() on node1 Executing query SELECT f1() on node1 Executing query INSERT INTO `postgres_database`.test_many_conc_3 SELECT number, number from numbers(10000) on instance Executing query INSERT INTO `postgres_database`.test_many_conc_3 SELECT number, number from numbers(10000) on instance Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node1 Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node1 run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query DROP TABLE IF EXISTS s3_test SYNC on node2 Executing query DROP TABLE IF EXISTS s3_test SYNC on node2 Stdout:6277 Stdout:6277 Executing query DROP FUNCTION f1 on node1 Executing query DROP FUNCTION f1 on node1 Executing query INSERT INTO `postgres_database`.test_many_conc_4 SELECT number, number from numbers(10000) on instance Executing query INSERT INTO `postgres_database`.test_many_conc_4 SELECT number, number from numbers(10000) on instance Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo2 to num2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo2 to num2 on node1 run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps -C clickhouse] [gw2] PASSED test_replicated_user_defined_functions/test.py::test_server_restart test_replicated_user_defined_functions/test.py::test_start_without_zookeeper Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node2 Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node2 Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 8 ? 00:00:17 clickhouse Stdout: 8 ? 00:00:17 clickhouse run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c pkill clickhouse] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8 Stdout:8 Executing query select ProfileEvents['SchedulerIOWriteRequests'] from system.query_log where query ilike '%workload=\'admin\'%' and type = 'QueryFinish' order by query_start_time_microseconds desc limit 1 on node Executing query select ProfileEvents['SchedulerIOWriteRequests'] from system.query_log where query ilike '%workload=\'admin\'%' and type = 'QueryFinish' order by query_start_time_microseconds desc limit 1 on node Executing query DROP TABLE IF EXISTS s3_test SYNC on node3 Executing query DROP TABLE IF EXISTS s3_test SYNC on node3 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo2 to num2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo2 to num2 on node1 Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query system flush logs on node Executing query system flush logs on node Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node3 Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node3 Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:6277 Stdout:6277 http://172.16.7.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 http://172.16.7.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 Executing query CREATE TABLE s3_test ON CLUSTER cluster ( dt Date, id Int64, data String, INDEX min_max (id) TYPE minmax GRANULARITY 3 ) ENGINE=ReplicatedMergeTree() PARTITION BY dt ORDER BY (dt, id) SETTINGS storage_policy='s3' ,min_rows_for_wide_part=8192 on node1 Executing query CREATE TABLE s3_test ON CLUSTER cluster ( dt Date, id Int64, data String, INDEX min_max (id) TYPE minmax GRANULARITY 3 ) ENGINE=ReplicatedMergeTree() PARTITION BY dt ORDER BY (dt, id) SETTINGS storage_policy='s3' ,min_rows_for_wide_part=8192 on node1 test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query INSERT INTO postgres_database.test_many_conc_0 SELECT 0*10000*(10000 + number), number from numbers(1000) on instance Executing query INSERT INTO postgres_database.test_many_conc_0 SELECT 0*10000*(10000 + number), number from numbers(1000) on instance Stdout:8 Stdout:8 Executing query INSERT INTO postgres_database.test_many_conc_1 SELECT 1*10000*(10000 + number), number from numbers(1000) on instance Executing query INSERT INTO postgres_database.test_many_conc_1 SELECT 1*10000*(10000 + number), number from numbers(1000) on instance run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query select ProfileEvents['SchedulerIOWriteBytes'] from system.query_log where query ilike '%workload=\'admin\'%' and type = 'QueryFinish' order by query_start_time_microseconds desc limit 1 on node Executing query select ProfileEvents['SchedulerIOWriteBytes'] from system.query_log where query ilike '%workload=\'admin\'%' and type = 'QueryFinish' order by query_start_time_microseconds desc limit 1 on node Stdout:6277 Stdout:6277 Executing query INSERT INTO s3_test VALUES ('2020-01-01',1,'TleXKlrzTe'),('2020-01-01',2,'kzDccleqbH'),('2020-01-01',3,'AReafgsxOF'),('2020-01-01',4,'GNSyagsXbL'),('2020-01-01',5,'bvoHzXwDqS'),('2020-01-01',6,'EEfcHfjHbO'),('2020-01-01',7,'xIrtwwaQeD'),('2020-01-01',8,'lzAHmnGQtm'),('2020-01-01',9,'VBpFqYMVTx'),('2020-01-01',10,'SGsJRBjGmI'),('2020-01-01',11,'TAoMXzwvZw'),('2020-01-01',12,'PjlkNOmwDq'),('2020-01-01',13,'uEKGtViTRA'),('2020-01-01',14,'iFQrosPFlW'),('2020-01-01',15,'GREXMVKmmh'),('2020-01-01',16,'YcJwgXiSuH'),('2020-01-01',17,'OWHQonKpJV'),('2020-01-01',18,'PSTCEAJmuD'),('2020-01-01',19,'VUMhUVzCHy'),('2020-01-01',20,'dgyAYUDHUJ'),('2020-01-01',21,'DXjVtwImqV'),('2020-01-01',22,'ZIJulvwMpB'),('2020-01-01',23,'TfOUShBxsQ'),('2020-01-01',24,'PhtoDZkcvQ'),('2020-01-01',25,'ztEqgBKSQx'),('2020-01-01',26,'WKhvatUPtH'),('2020-01-01',27,'DXFldZMkzj'),('2020-01-01',28,'bktDgMulzF'),('2020-01-01',29,'yGDVNVrjyw'),('2020-01-01',30,'gLIsCqoFDu'),('2020-01-01',31,'sCbpgXGveP'),('2020-01-01',32,'ZlU on node1 Executing query INSERT INTO s3_test VALUES ('2020-01-01',1,'TleXKlrzTe'),('2020-01-01',2,'kzDccleqbH'),('2020-01-01',3,'AReafgsxOF'),('2020-01-01',4,'GNSyagsXbL'),('2020-01-01',5,'bvoHzXwDqS'),('2020-01-01',6,'EEfcHfjHbO'),('2020-01-01',7,'xIrtwwaQeD'),('2020-01-01',8,'lzAHmnGQtm'),('2020-01-01',9,'VBpFqYMVTx'),('2020-01-01',10,'SGsJRBjGmI'),('2020-01-01',11,'TAoMXzwvZw'),('2020-01-01',12,'PjlkNOmwDq'),('2020-01-01',13,'uEKGtViTRA'),('2020-01-01',14,'iFQrosPFlW'),('2020-01-01',15,'GREXMVKmmh'),('2020-01-01',16,'YcJwgXiSuH'),('2020-01-01',17,'OWHQonKpJV'),('2020-01-01',18,'PSTCEAJmuD'),('2020-01-01',19,'VUMhUVzCHy'),('2020-01-01',20,'dgyAYUDHUJ'),('2020-01-01',21,'DXjVtwImqV'),('2020-01-01',22,'ZIJulvwMpB'),('2020-01-01',23,'TfOUShBxsQ'),('2020-01-01',24,'PhtoDZkcvQ'),('2020-01-01',25,'ztEqgBKSQx'),('2020-01-01',26,'WKhvatUPtH'),('2020-01-01',27,'DXFldZMkzj'),('2020-01-01',28,'bktDgMulzF'),('2020-01-01',29,'yGDVNVrjyw'),('2020-01-01',30,'gLIsCqoFDu'),('2020-01-01',31,'sCbpgXGveP'),('2020-01-01',32,'ZlU on node1 Executing query INSERT INTO postgres_database.test_many_conc_2 SELECT 2*10000*(10000 + number), number from numbers(1000) on instance Executing query INSERT INTO postgres_database.test_many_conc_2 SELECT 2*10000*(10000 + number), number from numbers(1000) on instance run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query INSERT INTO postgres_database.test_many_conc_3 SELECT 3*10000*(10000 + number), number from numbers(1000) on instance Executing query INSERT INTO postgres_database.test_many_conc_3 SELECT 3*10000*(10000 + number), number from numbers(1000) on instance Executing query optimize table data final on node Executing query optimize table data final on node Stdout:8 Stdout:8 Executing query INSERT INTO postgres_database.test_many_conc_1 SELECT 1*10000*(10001 + number), number from numbers(1000) on instance Executing query INSERT INTO postgres_database.test_many_conc_1 SELECT 1*10000*(10001 + number), number from numbers(1000) on instance Executing query INSERT INTO s3_test VALUES ('2020-01-02',1,'tTjfmxzcaB'),('2020-01-02',2,'cBbDPyYNph'),('2020-01-02',3,'nUogLDHJFo'),('2020-01-02',4,'GTJZneOzhe'),('2020-01-02',5,'VorbqjeKuX'),('2020-01-02',6,'VjIullmURN'),('2020-01-02',7,'pWcMgETVqw'),('2020-01-02',8,'FWybhQxZjs'),('2020-01-02',9,'KuwHwuootD'),('2020-01-02',10,'CoygnfjhnN'),('2020-01-02',11,'MWUhmYoLDS'),('2020-01-02',12,'RmmCrmWhRT'),('2020-01-02',13,'oOUNZiLVHC'),('2020-01-02',14,'vRogLyPiTs'),('2020-01-02',15,'AsdiRJJLMd'),('2020-01-02',16,'dChesgRkPx'),('2020-01-02',17,'AxsPJbuhEV'),('2020-01-02',18,'wqIwaRXgBd'),('2020-01-02',19,'zuDgGfBqyh'),('2020-01-02',20,'BaimDdAqzM'),('2020-01-02',21,'BnxcaBgQYf'),('2020-01-02',22,'dzIhnsbfwO'),('2020-01-02',23,'SzLsEXbSPt'),('2020-01-02',24,'iAzNMqCZdj'),('2020-01-02',25,'wjOuGkYARf'),('2020-01-02',26,'nsVNhCAYjf'),('2020-01-02',27,'JnPjedyIzp'),('2020-01-02',28,'AaEkkhxcMb'),('2020-01-02',29,'IgNXTeTLXu'),('2020-01-02',30,'VyQIGvFBUt'),('2020-01-02',31,'XnJTukDryi'),('2020-01-02',32,'mFn on node2 Executing query INSERT INTO s3_test VALUES ('2020-01-02',1,'tTjfmxzcaB'),('2020-01-02',2,'cBbDPyYNph'),('2020-01-02',3,'nUogLDHJFo'),('2020-01-02',4,'GTJZneOzhe'),('2020-01-02',5,'VorbqjeKuX'),('2020-01-02',6,'VjIullmURN'),('2020-01-02',7,'pWcMgETVqw'),('2020-01-02',8,'FWybhQxZjs'),('2020-01-02',9,'KuwHwuootD'),('2020-01-02',10,'CoygnfjhnN'),('2020-01-02',11,'MWUhmYoLDS'),('2020-01-02',12,'RmmCrmWhRT'),('2020-01-02',13,'oOUNZiLVHC'),('2020-01-02',14,'vRogLyPiTs'),('2020-01-02',15,'AsdiRJJLMd'),('2020-01-02',16,'dChesgRkPx'),('2020-01-02',17,'AxsPJbuhEV'),('2020-01-02',18,'wqIwaRXgBd'),('2020-01-02',19,'zuDgGfBqyh'),('2020-01-02',20,'BaimDdAqzM'),('2020-01-02',21,'BnxcaBgQYf'),('2020-01-02',22,'dzIhnsbfwO'),('2020-01-02',23,'SzLsEXbSPt'),('2020-01-02',24,'iAzNMqCZdj'),('2020-01-02',25,'wjOuGkYARf'),('2020-01-02',26,'nsVNhCAYjf'),('2020-01-02',27,'JnPjedyIzp'),('2020-01-02',28,'AaEkkhxcMb'),('2020-01-02',29,'IgNXTeTLXu'),('2020-01-02',30,'VyQIGvFBUt'),('2020-01-02',31,'XnJTukDryi'),('2020-01-02',32,'mFn on node2 Executing query INSERT INTO postgres_database.test_many_conc_4 SELECT 4*10000*(10000 + number), number from numbers(1000) on instance Executing query INSERT INTO postgres_database.test_many_conc_4 SELECT 4*10000*(10000 + number), number from numbers(1000) on instance run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query INSERT INTO postgres_database.test_many_conc_2 SELECT 2*10000*(10001 + number), number from numbers(1000) on instance Executing query INSERT INTO postgres_database.test_many_conc_2 SELECT 2*10000*(10001 + number), number from numbers(1000) on instance Executing query INSERT INTO postgres_database.test_many_conc_3 SELECT 3*10000*(10001 + number), number from numbers(1000) on instance Executing query INSERT INTO postgres_database.test_many_conc_3 SELECT 3*10000*(10001 + number), number from numbers(1000) on instance No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw5-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw5-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/2162f4a322280d95d364eec5582ac08aa25e06312975764c525b40370c1372e1/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/2162f4a322280d95d364eec5582ac08aa25e06312975764c525b40370c1372e1/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/2162f4a322280d95d364eec5582ac08aa25e06312975764c525b40370c1372e1/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/2162f4a322280d95d364eec5582ac08aa25e06312975764c525b40370c1372e1/json HTTP/1.1" 200 586 Executing query INSERT INTO postgres_database.test_many_conc_4 SELECT 4*10000*(10001 + number), number from numbers(1000) on instance Executing query INSERT INTO postgres_database.test_many_conc_4 SELECT 4*10000*(10001 + number), number from numbers(1000) on instance Executing query INSERT INTO s3_test VALUES ('2020-01-03',1,'eWbdjFzdpP'),('2020-01-03',2,'jQFZlXPxID'),('2020-01-03',3,'oBKkktSfIz'),('2020-01-03',4,'sGYzwsxBpU'),('2020-01-03',5,'EtSzLIdlos'),('2020-01-03',6,'ykKJlWyuox'),('2020-01-03',7,'pYqjsTarDl'),('2020-01-03',8,'BEMKdwuCdT'),('2020-01-03',9,'iXdcPSNAJW'),('2020-01-03',10,'lCBLDgAmss'),('2020-01-03',11,'yJFPWGIJMz'),('2020-01-03',12,'SfuIJMuYFE'),('2020-01-03',13,'SfWDKenXae'),('2020-01-03',14,'xynkNvoTCB'),('2020-01-03',15,'iwGsQJCYZX'),('2020-01-03',16,'dpSVgjyQsV'),('2020-01-03',17,'qxHFSfOJmz'),('2020-01-03',18,'yiHADwvezD'),('2020-01-03',19,'WxoDLkPwvb'),('2020-01-03',20,'IeQZDAFpjg'),('2020-01-03',21,'oqkOLKOPwk'),('2020-01-03',22,'ZcvqbstyvV'),('2020-01-03',23,'ETqUrbPQFN'),('2020-01-03',24,'UJOeOGjCLL'),('2020-01-03',25,'UToOYoIPcs'),('2020-01-03',26,'ghqiOyIrTR'),('2020-01-03',27,'PjQgFNwZcs'),('2020-01-03',28,'sVrKUfPvZV'),('2020-01-03',29,'CqPFdOFhUb'),('2020-01-03',30,'SXNEBLMTZk'),('2020-01-03',31,'wbxhEqTwFk'),('2020-01-03',32,'QvZ on node3 Executing query INSERT INTO s3_test VALUES ('2020-01-03',1,'eWbdjFzdpP'),('2020-01-03',2,'jQFZlXPxID'),('2020-01-03',3,'oBKkktSfIz'),('2020-01-03',4,'sGYzwsxBpU'),('2020-01-03',5,'EtSzLIdlos'),('2020-01-03',6,'ykKJlWyuox'),('2020-01-03',7,'pYqjsTarDl'),('2020-01-03',8,'BEMKdwuCdT'),('2020-01-03',9,'iXdcPSNAJW'),('2020-01-03',10,'lCBLDgAmss'),('2020-01-03',11,'yJFPWGIJMz'),('2020-01-03',12,'SfuIJMuYFE'),('2020-01-03',13,'SfWDKenXae'),('2020-01-03',14,'xynkNvoTCB'),('2020-01-03',15,'iwGsQJCYZX'),('2020-01-03',16,'dpSVgjyQsV'),('2020-01-03',17,'qxHFSfOJmz'),('2020-01-03',18,'yiHADwvezD'),('2020-01-03',19,'WxoDLkPwvb'),('2020-01-03',20,'IeQZDAFpjg'),('2020-01-03',21,'oqkOLKOPwk'),('2020-01-03',22,'ZcvqbstyvV'),('2020-01-03',23,'ETqUrbPQFN'),('2020-01-03',24,'UJOeOGjCLL'),('2020-01-03',25,'UToOYoIPcs'),('2020-01-03',26,'ghqiOyIrTR'),('2020-01-03',27,'PjQgFNwZcs'),('2020-01-03',28,'sVrKUfPvZV'),('2020-01-03',29,'CqPFdOFhUb'),('2020-01-03',30,'SXNEBLMTZk'),('2020-01-03',31,'wbxhEqTwFk'),('2020-01-03',32,'QvZ on node3 run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8 Stdout:8 Executing query SELECT * FROM s3_test order by dt, id FORMAT Values on node1 Executing query SELECT * FROM s3_test order by dt, id FORMAT Values on node1 Executing query SELECT * FROM s3_test order by dt, id FORMAT Values on node2 Executing query SELECT * FROM s3_test order by dt, id FORMAT Values on node2 run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:7083 Stdout:7083 Clickhouse process running. Clickhouse process running. run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:7083 Stdout:7083 Executing query select 20 on node Executing query select 20 on node run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query SELECT * FROM s3_test order by dt, id FORMAT Values on node3 Executing query SELECT * FROM s3_test order by dt, id FORMAT Values on node3 Executing query CREATE FUNCTION f1 AS (x, y) -> x + y on node1 Executing query CREATE FUNCTION f1 AS (x, y) -> x + y on node1 Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/admin' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/admin' on node Stopping zookeeper node: zoo1 Stopping zookeeper node: zoo1 Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo1] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo1] http://172.16.7.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 http://172.16.7.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 Executing query DROP TABLE IF EXISTS s3_test SYNC on node1 Executing query DROP TABLE IF EXISTS s3_test SYNC on node1 [gw6] PASSED test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12] Executing query select dequeued_cost from system.scheduler where resource='network_read' and path='/prio/admin' on node Executing query select dequeued_cost from system.scheduler where resource='network_read' and path='/prio/admin' on node Executing query select 20 on node Executing query select 20 on node Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node1 Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node1 Executing query select budget from system.scheduler where resource='network_read' and path='/prio/admin' on node Executing query select budget from system.scheduler where resource='network_read' and path='/prio/admin' on node Executing query DROP TABLE IF EXISTS s3_test SYNC on node2 Executing query DROP TABLE IF EXISTS s3_test SYNC on node2 Executing query select count() from data where not ignore(*) SETTINGS workload='admin' on node Executing query select count() from data where not ignore(*) SETTINGS workload='admin' on node Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopped Stopping zookeeper node: zoo2 Stopping zookeeper node: zoo2 Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo2] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo2] Executing query select 20 on node Executing query select 20 on node Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node2 Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node2 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Executing query DROP TABLE IF EXISTS s3_test SYNC on node3 Executing query DROP TABLE IF EXISTS s3_test SYNC on node3 Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/admin' on node Executing query select dequeued_requests from system.scheduler where resource='network_read' and path='/prio/admin' on node Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Executing query ALTER TABLE test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster RENAME COLUMN foo3 to num2 on node1 Executing query select dequeued_cost from system.scheduler where resource='network_read' and path='/prio/admin' on node Executing query select dequeued_cost from system.scheduler where resource='network_read' and path='/prio/admin' on node Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node3 Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node3 Executing query select 20 on node Executing query select 20 on node Executing query select budget from system.scheduler where resource='network_read' and path='/prio/admin' on node Executing query select budget from system.scheduler where resource='network_read' and path='/prio/admin' on node http://172.16.7.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 http://172.16.7.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 Executing query CREATE TABLE s3_test ON CLUSTER cluster ( dt Date, id Int64, data String, INDEX min_max (id) TYPE minmax GRANULARITY 3 ) ENGINE=ReplicatedMergeTree() PARTITION BY dt ORDER BY (dt, id) SETTINGS storage_policy='s3' on node1 Executing query CREATE TABLE s3_test ON CLUSTER cluster ( dt Date, id Int64, data String, INDEX min_max (id) TYPE minmax GRANULARITY 3 ) ENGINE=ReplicatedMergeTree() PARTITION BY dt ORDER BY (dt, id) SETTINGS storage_policy='s3' on node1 test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(1000) on node1 Executing query SET max_partitions_per_insert_block = 10000000; INSERT INTO test_rename_distributed_parallel_insert_and_select (num,num2) SELECT number + 0 AS num, number + 1 + 0 AS num2 FROM numbers_mt(1000) on node1 Executing query system flush logs on node Executing query system flush logs on node Executing query INSERT INTO s3_test VALUES ('2020-01-02',1,'poEjXjEUzG'),('2020-01-02',2,'zsLzkOPjXN') on node1 Executing query INSERT INTO s3_test VALUES ('2020-01-02',1,'poEjXjEUzG'),('2020-01-02',2,'zsLzkOPjXN') on node1 Executing query select 20 on node Executing query select 20 on node Executing query DETACH TABLE s3_test; on node1 Executing query DETACH TABLE s3_test; on node1 Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); on node Executing query SYSTEM DROP REPLICA '1' FROM TABLE s3_test; on node2 Executing query SYSTEM DROP REPLICA '1' FROM TABLE s3_test; on node2 run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/no_such_table_column_family_option/max_bytes_for_level_base/g' /etc/clickhouse-server/config.d/rocksdb.xml"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/no_such_table_column_family_option/max_bytes_for_level_base/g' /etc/clickhouse-server/config.d/rocksdb.xml"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c sed -i 's/no_such_table_column_family_option/max_bytes_for_level_base/g' /etc/clickhouse-server/config.d/rocksdb.xml] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c sed -i 's/no_such_table_column_family_option/max_bytes_for_level_base/g' /etc/clickhouse-server/config.d/rocksdb.xml] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c ps -C clickhouse] Executing query INSERT INTO s3_test VALUES ('2020-01-02',1,'QZaUPMhatT'),('2020-01-02',2,'bRWVkcSYnb') on node2 Executing query INSERT INTO s3_test VALUES ('2020-01-02',1,'QZaUPMhatT'),('2020-01-02',2,'bRWVkcSYnb') on node2 Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 7083 ? 00:00:04 clickhouse Stdout: 7083 ? 00:00:04 clickhouse run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c pkill clickhouse] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:7083 Stdout:7083 Executing query ATTACH TABLE s3_test; on node1 Executing query ATTACH TABLE s3_test; on node1 Executing query select ProfileEvents['SchedulerIOReadRequests'] from system.query_log where query ilike '%workload=\'admin\'%' and type = 'QueryFinish' order by query_start_time_microseconds desc limit 1 on node Executing query select ProfileEvents['SchedulerIOReadRequests'] from system.query_log where query ilike '%workload=\'admin\'%' and type = 'QueryFinish' order by query_start_time_microseconds desc limit 1 on node Executing query SYSTEM RESTORE REPLICA s3_test; on node1 Executing query SYSTEM RESTORE REPLICA s3_test; on node1 Executing query system flush logs on node Executing query system flush logs on node Executing query SELECT count() FROM system.replication_queue WHERE table='s3_test' and type='ATTACH_PART' on node1 Executing query SELECT count() FROM system.replication_queue WHERE table='s3_test' and type='ATTACH_PART' on node1 Executing query DROP TABLE IF EXISTS s3_test SYNC on node1 Executing query DROP TABLE IF EXISTS s3_test SYNC on node1 [gw6] PASSED test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:7083 Stdout:7083 Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node1 Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node1 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node1 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node1 Executing query INSERT INTO postgres_database.test_many_conc_0 SELECT 50001 + number, number from numbers(5000) on instance Executing query INSERT INTO postgres_database.test_many_conc_0 SELECT 50001 + number, number from numbers(5000) on instance Executing query DROP TABLE IF EXISTS s3_test SYNC on node2 Executing query DROP TABLE IF EXISTS s3_test SYNC on node2 Executing query INSERT INTO postgres_database.test_many_conc_1 SELECT 50002 + number, number from numbers(5000) on instance Executing query INSERT INTO postgres_database.test_many_conc_1 SELECT 50002 + number, number from numbers(5000) on instance Executing query select ProfileEvents['SchedulerIOReadBytes'] from system.query_log where query ilike '%workload=\'admin\'%' and type = 'QueryFinish' order by query_start_time_microseconds desc limit 1 on node Executing query select ProfileEvents['SchedulerIOReadBytes'] from system.query_log where query ilike '%workload=\'admin\'%' and type = 'QueryFinish' order by query_start_time_microseconds desc limit 1 on node Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node2 Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node2 Executing query DROP TABLE IF EXISTS s3_test SYNC on node3 Executing query DROP TABLE IF EXISTS s3_test SYNC on node3 Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node [gw1] PASSED test_scheduler/test.py::test_s3_resource_request_granularity Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node test_scheduler/test.py::test_throw_on_unknown_workload run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query INSERT INTO postgres_database.test_many_conc_2 SELECT 50003 + number, number from numbers(5000) on instance Executing query INSERT INTO postgres_database.test_many_conc_2 SELECT 50003 + number, number from numbers(5000) on instance Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node2 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node2 Stdout:7083 Stdout:7083 run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Executing query system reload config on node Executing query system reload config on node Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node3 Executing query DROP TABLE IF EXISTS test_drop_table SYNC on node3 Executing query INSERT INTO postgres_database.test_many_conc_3 SELECT 50004 + number, number from numbers(5000) on instance Executing query INSERT INTO postgres_database.test_many_conc_3 SELECT 50004 + number, number from numbers(5000) on instance http://172.16.7.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 http://172.16.7.7:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/.env --project-name roottestreplicatedmergetrees3zerocopy-gw6 --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node3/docker-compose.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/.env --project-name roottestreplicatedmergetrees3zerocopy-gw6 --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node3/docker-compose.yml stop --timeout 20] Executing query INSERT INTO postgres_database.test_many_conc_4 SELECT 50005 + number, number from numbers(5000) on instance Executing query INSERT INTO postgres_database.test_many_conc_4 SELECT 50005 + number, number from numbers(5000) on instance Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3_no_resource'; on node Executing query drop table if exists data; create table data (key UInt64 CODEC(NONE)) engine=MergeTree() order by tuple() settings min_bytes_for_wide_part=1e9, storage_policy='s3_no_resource'; on node Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node3 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node3 run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query create resource io (write any disk, read any disk); create workload all settings max_cost = 1000000; on node Executing query create resource io (write any disk, read any disk); create workload all settings max_cost = 1000000; on node Executing query SELECT * FROM `test_database`.`test_many_conc_0` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`test_many_conc_0` LIMIT 1 FORMAT Null on instance Stdout:7083 Stdout:7083 Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query insert into data select * from numbers(1e5) on node Executing query insert into data select * from numbers(1e5) on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_many_conc_0' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_many_conc_0' on instance Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node4 Executing query SELECT count() FROM test_rename_distributed_parallel_insert_and_select WHERE num2 % 1000 > 0 on node4 Executing query select dequeued_requests>0 from system.scheduler where resource='io' and path ilike '%/all/%' and type='fifo' on node Executing query select dequeued_requests>0 from system.scheduler where resource='io' and path ilike '%/all/%' and type='fifo' on node Executing query select * from `postgres_database`.`test_many_conc_0` order by key; on instance Executing query select * from `postgres_database`.`test_many_conc_0` order by key; on instance Executing query select * from `test_database`.`test_many_conc_0` order by key; on instance Executing query select * from `test_database`.`test_many_conc_0` order by key; on instance run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo 'true' > /etc/clickhouse-server/config.d/workloads.xml"] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo 'true' > /etc/clickhouse-server/config.d/workloads.xml"] Command:[docker exec roottestscheduler-gw1-node-1 bash -c echo 'true' > /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c echo 'true' > /etc/clickhouse-server/config.d/workloads.xml] Executing query system reload config on node Executing query system reload config on node run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query DROP TABLE IF EXISTS test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster SYNC on node1 Executing query DROP TABLE IF EXISTS test_rename_distributed_parallel_insert_and_select ON CLUSTER test_cluster SYNC on node1 run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query SELECT count() FROM postgres_database.test_many_conc_0 on instance Executing query SELECT count() FROM postgres_database.test_many_conc_0 on instance No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw5-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw5-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/baf4e458662aa45c929e1452de0cbd767054a469a34e84dbf05d4778c45a00a4/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/baf4e458662aa45c929e1452de0cbd767054a469a34e84dbf05d4778c45a00a4/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/baf4e458662aa45c929e1452de0cbd767054a469a34e84dbf05d4778c45a00a4/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/baf4e458662aa45c929e1452de0cbd767054a469a34e84dbf05d4778c45a00a4/json HTTP/1.1" 200 586 Executing query insert into data select * from numbers(1e5) on node Executing query insert into data select * from numbers(1e5) on node Executing query SELECT count() FROM (SELECT * FROM test_database.test_many_conc_0) on instance Executing query SELECT count() FROM (SELECT * FROM test_database.test_many_conc_0) on instance Executing query DROP TABLE IF EXISTS test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster SYNC on node1 Executing query DROP TABLE IF EXISTS test_rename_distributed_parallel_insert_and_select_replicated ON CLUSTER test_cluster SYNC on node1 Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node [gw1] PASSED test_scheduler/test.py::test_throw_on_unknown_workload test_scheduler/test.py::test_workload_entity_keeper_storage Executing query SELECT * FROM `test_database`.`test_many_conc_1` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`test_many_conc_1` LIMIT 1 FORMAT Null on instance run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_many_conc_1' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_many_conc_1' on instance run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Executing query system reload config on node Executing query system reload config on node run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:7872 Stdout:7872 Clickhouse process running. Clickhouse process running. run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query select * from `postgres_database`.`test_many_conc_1` order by key; on instance Executing query select * from `postgres_database`.`test_many_conc_1` order by key; on instance Stdout:7872 Stdout:7872 Executing query select 20 on node Executing query select 20 on node Executing query create resource io_write (write disk s3_no_resource); on node Executing query create resource io_write (write disk s3_no_resource); on node Executing query select * from `test_database`.`test_many_conc_1` order by key; on instance Executing query select * from `test_database`.`test_many_conc_1` order by key; on instance Executing query create resource io_read (read disk s3_no_resource); on node Executing query create resource io_read (read disk s3_no_resource); on node Executing query SELECT count() FROM postgres_database.test_many_conc_1 on instance Executing query SELECT count() FROM postgres_database.test_many_conc_1 on instance Executing query select 20 on node Executing query select 20 on node Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Executing query SELECT count() FROM (SELECT * FROM test_database.test_many_conc_1) on instance Executing query SELECT count() FROM (SELECT * FROM test_database.test_many_conc_1) on instance http://localhost:None "POST /v1.46/containers/create HTTP/1.1" 201 88 http://localhost:None "POST /v1.46/containers/create HTTP/1.1" 201 88 http://localhost:None "GET /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/json HTTP/1.1" 200 None http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/start HTTP/1.1" 204 0 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/start HTTP/1.1" 204 0 [network] Created new container 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e [network] Created new container 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/353fec0a870be460b34cecfe0978f366ab2f97b0ee758988590361180be0755d/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/353fec0a870be460b34cecfe0978f366ab2f97b0ee758988590361180be0755d/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/353fec0a870be460b34cecfe0978f366ab2f97b0ee758988590361180be0755d/json HTTP/1.1" 200 461 http://localhost:None "GET /v1.46/exec/353fec0a870be460b34cecfe0978f366ab2f97b0ee758988590361180be0755d/json HTTP/1.1" 200 461 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/80c45e31220e288dd029c1e19620b76c4b8e6428b46c449e934f7319d134fec8/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/80c45e31220e288dd029c1e19620b76c4b8e6428b46c449e934f7319d134fec8/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/80c45e31220e288dd029c1e19620b76c4b8e6428b46c449e934f7319d134fec8/json HTTP/1.1" 200 461 http://localhost:None "GET /v1.46/exec/80c45e31220e288dd029c1e19620b76c4b8e6428b46c449e934f7319d134fec8/json HTTP/1.1" 200 461 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): Executing query create workload all; on node Executing query create workload all; on node Executing query select 20 on node Executing query select 20 on node Executing query SELECT * FROM `test_database`.`test_many_conc_2` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`test_many_conc_2` LIMIT 1 FORMAT Null on instance Executing query create workload X in all settings priority = 0; on node Executing query create workload X in all settings priority = 0; on node Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-resolver-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-resolver-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-node1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-node1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-node1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-node1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo2-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo2-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo3-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo3-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-minio1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-minio1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-minio1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-minio1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo2-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo2-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo3-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo3-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-resolver-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-resolver-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy2-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy2-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy2-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy2-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Executing query create workload Y in all settings priority = 1; on node Executing query create workload Y in all settings priority = 1; on node Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopped Stopping zookeeper node: zoo3 Stopping zookeeper node: zoo3 Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo3] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo3] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/.env --project-name roottestreplicateds3zerocopydroppartition-gw7 --file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/.env --project-name roottestreplicateds3zerocopydroppartition-gw7 --file /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances-0-gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_many_conc_2' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_many_conc_2' on instance Executing query create workload A1 in X settings priority = -1; on node Executing query create workload A1 in X settings priority = -1; on node Executing query select 20 on node Executing query select 20 on node [gw3] PASSED test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 test_rename_column/test.py::test_rename_parallel Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 Executing query select * from `postgres_database`.`test_many_conc_2` order by key; on instance Executing query select * from `postgres_database`.`test_many_conc_2` order by key; on instance Executing query create workload B1 in X settings priority = 1; on node Executing query create workload B1 in X settings priority = 1; on node [gw3] SKIPPED test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 Executing query create workload C1 in Y settings priority = -1; on node Executing query create workload C1 in Y settings priority = -1; on node Executing query select * from `test_database`.`test_many_conc_2` order by key; on instance Executing query select * from `test_database`.`test_many_conc_2` order by key; on instance Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-node1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-node1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-resolver-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-resolver-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-resolver-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-resolver-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-resolver-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-resolver-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-node1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-node1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-node1-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-node1-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-node1-1 Removed Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-node1-1 Removed Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo2-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo2-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo3-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo3-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-minio1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-minio1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo3-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo3-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo3-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo3-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo2-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo2-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo2-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo2-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-minio1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-minio1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-minio1-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-minio1-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo1-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo1-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-resolver-1 Removed Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-resolver-1 Removed Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo1-1 Removed Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo1-1 Removed Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo2-1 Removed Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo2-1 Removed Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo3-1 Removed Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-zoo3-1 Removed Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-minio1-1 Removed Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-minio1-1 Removed Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy1-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy2-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy2-1 Stopping Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy2-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy2-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy2-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy2-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy1-1 Stopped Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy1-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy1-1 Removing Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy1-1 Removed Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy1-1 Removed Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy2-1 Removed Stderr: Container roottestreplicateds3zerocopydroppartition-gw7-proxy2-1 Removed Stderr: Volume roottestreplicateds3zerocopydroppartition-gw7_data1-1 Removing Stderr: Volume roottestreplicateds3zerocopydroppartition-gw7_data1-1 Removing Stderr: Network roottestreplicateds3zerocopydroppartition-gw7_default Removing Stderr: Network roottestreplicateds3zerocopydroppartition-gw7_default Removing Stderr: Volume roottestreplicateds3zerocopydroppartition-gw7_data1-1 Removed Stderr: Volume roottestreplicateds3zerocopydroppartition-gw7_data1-1 Removed Stderr: Network roottestreplicateds3zerocopydroppartition-gw7_default Removed Stderr: Network roottestreplicateds3zerocopydroppartition-gw7_default Removed Cleanup called Cleanup called Docker networks for project roottestreplicateds3zerocopydroppartition-gw7 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicateds3zerocopydroppartition-gw7 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicateds3zerocopydroppartition-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicateds3zerocopydroppartition-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicateds3zerocopydroppartition-gw7 are DRIVER VOLUME NAME Docker volumes for project roottestreplicateds3zerocopydroppartition-gw7 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreplicateds3zerocopydroppartition-gw7-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreplicateds3zerocopydroppartition-gw7-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicateds3zerocopydroppartition-gw7 No running containers for project: roottestreplicateds3zerocopydroppartition-gw7 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Executing query create workload D1 in Y settings priority = 1; on node Executing query create workload D1 in Y settings priority = 1; on node Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:11 Stdout:11 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 11 Volumes pruned: 11 Running tests in /ClickHouse/tests/integration/test_restore_external_engines/test.py Running tests in /ClickHouse/tests/integration/test_restore_external_engines/test.py Cluster start called. is_up=False Cluster start called. is_up=False test_restore_external_engines/test.py::test_restore_table Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 [gw3] SKIPPED test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert Executing query select 20 on node Executing query select 20 on node Docker networks for project roottestrestoreexternalengines-gw7 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestrestoreexternalengines-gw7 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestrestoreexternalengines-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestrestoreexternalengines-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestrestoreexternalengines-gw7 are DRIVER VOLUME NAME Docker volumes for project roottestrestoreexternalengines-gw7 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottestrestoreexternalengines-gw7 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestrestoreexternalengines-gw7 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestrestoreexternalengines-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestrestoreexternalengines-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestrestoreexternalengines-gw7 are DRIVER VOLUME NAME Docker volumes for project roottestrestoreexternalengines-gw7 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestrestoreexternalengines-gw7-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestrestoreexternalengines-gw7-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestrestoreexternalengines-gw7 No running containers for project: roottestrestoreexternalengines-gw7 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Executing query create workload A2 in X settings priority = -1; on node Executing query create workload A2 in X settings priority = -1; on node Executing query SELECT count() FROM postgres_database.test_many_conc_2 on instance Executing query SELECT count() FROM postgres_database.test_many_conc_2 on instance Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:11 Stdout:11 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 11 Volumes pruned: 11 Setup directory for instance: replica1 Setup directory for instance: replica1 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_restore_external_engines/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_restore_external_engines/configs/backups_disk.xml'] to /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica1/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_restore_external_engines/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_restore_external_engines/configs/backups_disk.xml'] to /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica1/configs/config.d Setup database dir /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica1/database Setup database dir /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica1/database Setup logs dir /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica1/logs Setup logs dir /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica1/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] external_dir_abs_path=/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/backups external_dir_abs_path=/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/backups Setup directory for instance: replica2 Setup directory for instance: replica2 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_restore_external_engines/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_restore_external_engines/configs/backups_disk.xml'] to /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica2/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_restore_external_engines/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_restore_external_engines/configs/backups_disk.xml'] to /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica2/configs/config.d Setup database dir /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica2/database Setup database dir /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica2/database Setup logs dir /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica2/logs Setup logs dir /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica2/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] external_dir_abs_path=/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/backups external_dir_abs_path=/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/backups Setup directory for instance: replica3 Setup directory for instance: replica3 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_restore_external_engines/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_restore_external_engines/configs/backups_disk.xml'] to /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica3/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_restore_external_engines/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_restore_external_engines/configs/backups_disk.xml'] to /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica3/configs/config.d Setup database dir /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica3/database Setup database dir /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica3/database Setup logs dir /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica3/logs Setup logs dir /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica3/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] external_dir_abs_path=/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/backups external_dir_abs_path=/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/backups Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper3/coordination', 'MYSQL8_HOST': 'mysql80', 'MYSQL8_PORT': '3306', 'MYSQL8_ROOT_HOST': '%', 'MYSQL8_LOGS': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/mysql8/logs', 'MYSQL8_LOGS_FS': 'bind', 'MYSQL8_DOCKER_USER': '0'} stored in /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper3/coordination', 'MYSQL8_HOST': 'mysql80', 'MYSQL8_PORT': '3306', 'MYSQL8_ROOT_HOST': '%', 'MYSQL8_LOGS': '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/mysql8/logs', 'MYSQL8_LOGS_FS': 'bind', 'MYSQL8_DOCKER_USER': '0'} stored in /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/.env --project-name roottestrestoreexternalengines-gw7 --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_mysql_8_0.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica2/docker-compose.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica3/docker-compose.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/.env --project-name roottestrestoreexternalengines-gw7 --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_mysql_8_0.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica2/docker-compose.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica3/docker-compose.yml pull] [gw5] PASSED test_rocksdb_options/test.py::test_table_invalid_column_family_options run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/max_open_files/no_such_table_option/g' /etc/clickhouse-server/config.d/rocksdb.xml"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/max_open_files/no_such_table_option/g' /etc/clickhouse-server/config.d/rocksdb.xml"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c sed -i 's/max_open_files/no_such_table_option/g' /etc/clickhouse-server/config.d/rocksdb.xml] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c sed -i 's/max_open_files/no_such_table_option/g' /etc/clickhouse-server/config.d/rocksdb.xml] test_rocksdb_options/test.py::test_table_invalid_options Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 [gw3] SKIPPED test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c ps -C clickhouse] Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 7872 ? 00:00:05 clickhouse Stdout: 7872 ? 00:00:05 clickhouse run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c pkill clickhouse] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query create workload B2 in X settings priority = 1; on node Executing query create workload B2 in X settings priority = 1; on node Executing query SELECT count() FROM (SELECT * FROM test_database.test_many_conc_2) on instance Executing query SELECT count() FROM (SELECT * FROM test_database.test_many_conc_2) on instance Stdout:7872 Stdout:7872 [gw3] SKIPPED test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 Executing query create workload C2 in Y settings priority = -1; on node Executing query create workload C2 in Y settings priority = -1; on node Executing query SELECT * FROM `test_database`.`test_many_conc_3` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`test_many_conc_3` LIMIT 1 FORMAT Null on instance [gw3] SKIPPED test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 Executing query create workload D2 in Y settings priority = 1; on node Executing query create workload D2 in Y settings priority = 1; on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_many_conc_3' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_many_conc_3' on instance Executing query drop workload A1; on node Executing query drop workload A1; on node [gw3] SKIPPED test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 Executing query select * from `postgres_database`.`test_many_conc_3` order by key; on instance Executing query select * from `postgres_database`.`test_many_conc_3` order by key; on instance run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:7872 Stdout:7872 Executing query drop workload A2; on node Executing query drop workload A2; on node [gw3] SKIPPED test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node1 Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node_no_proxy-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node_no_proxy-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-resolver-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-resolver-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node_no_proxy-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node_no_proxy-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node_no_proxy-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node_no_proxy-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node_no_proxy-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node_no_proxy-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node_no_proxy-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node_no_proxy-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node_no_proxy-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node_no_proxy-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-minio1-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-minio1-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-minio1-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-minio1-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-resolver-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-resolver-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy2-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy2-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy1-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy1-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy2-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy2-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy1-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy1-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node_no_proxy/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node_no_proxy/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node_no_proxy/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node_no_proxy/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node_no_proxy/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node_no_proxy/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node_no_proxy/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node_no_proxy/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Executing query select * from `test_database`.`test_many_conc_3` order by key; on instance Executing query select * from `test_database`.`test_many_conc_3` order by key; on instance Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node_no_proxy/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node_no_proxy/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node_no_proxy/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node_no_proxy/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/.env --project-name roottests3tablefunctionwithhttpproxy-gw4 --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node_no_proxy/docker-compose.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/.env --project-name roottests3tablefunctionwithhttpproxy-gw4 --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/remote_proxy_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/proxy_list_node_no_proxy/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node/docker-compose.yml --file /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/env_node_no_proxy/docker-compose.yml down --volumes] Executing query drop workload B1; on node Executing query drop workload B1; on node [gw3] SKIPPED test_rename_column/test.py::test_rename_with_parallel_ttl_move Command:[docker compose --env-file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/.env --project-name roottestrenamecolumn-gw3 --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node3/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node4/docker-compose.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/.env --project-name roottestrenamecolumn-gw3 --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node3/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node4/docker-compose.yml stop --timeout 20] Executing query SELECT count() FROM postgres_database.test_many_conc_3 on instance Executing query SELECT count() FROM postgres_database.test_many_conc_3 on instance Executing query drop workload B2; on node Executing query drop workload B2; on node Executing query SELECT count() FROM (SELECT * FROM test_database.test_many_conc_3) on instance Executing query SELECT count() FROM (SELECT * FROM test_database.test_many_conc_3) on instance Executing query drop workload C1; on node Executing query drop workload C1; on node run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:7872 Stdout:7872 Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-resolver-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-resolver-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node_no_proxy-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node_no_proxy-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node_no_proxy-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node_no_proxy-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node_no_proxy-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node_no_proxy-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-resolver-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-resolver-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-resolver-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-resolver-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node_no_proxy-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node_no_proxy-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node_no_proxy-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node_no_proxy-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node_no_proxy-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node_no_proxy-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node_no_proxy-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node_no_proxy-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node_no_proxy-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node_no_proxy-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node_no_proxy-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node_no_proxy-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-resolver-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-resolver-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node_no_proxy-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node_no_proxy-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node_no_proxy-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy_list_node_no_proxy-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-env_node-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node_no_proxy-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-remote_proxy_node_no_proxy-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-minio1-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-minio1-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-minio1-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-minio1-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-minio1-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-minio1-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-minio1-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-minio1-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy1-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy1-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy2-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy2-1 Stopping Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy1-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy1-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy1-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy1-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy2-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy2-1 Stopped Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy2-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy2-1 Removing Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy2-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy2-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy1-1 Removed Stderr: Container roottests3tablefunctionwithhttpproxy-gw4-proxy1-1 Removed Stderr: Volume roottests3tablefunctionwithhttpproxy-gw4_data1-1 Removing Stderr: Volume roottests3tablefunctionwithhttpproxy-gw4_data1-1 Removing Stderr: Network roottests3tablefunctionwithhttpproxy-gw4_default Removing Stderr: Network roottests3tablefunctionwithhttpproxy-gw4_default Removing Stderr: Volume roottests3tablefunctionwithhttpproxy-gw4_data1-1 Removed Stderr: Volume roottests3tablefunctionwithhttpproxy-gw4_data1-1 Removed Stderr: Network roottests3tablefunctionwithhttpproxy-gw4_default Removed Stderr: Network roottests3tablefunctionwithhttpproxy-gw4_default Removed Cleanup called Cleanup called Docker networks for project roottests3tablefunctionwithhttpproxy-gw4 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3tablefunctionwithhttpproxy-gw4 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3tablefunctionwithhttpproxy-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3tablefunctionwithhttpproxy-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3tablefunctionwithhttpproxy-gw4 are DRIVER VOLUME NAME Docker volumes for project roottests3tablefunctionwithhttpproxy-gw4 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3tablefunctionwithhttpproxy-gw4-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3tablefunctionwithhttpproxy-gw4-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3tablefunctionwithhttpproxy-gw4 No running containers for project: roottests3tablefunctionwithhttpproxy-gw4 Trying to prune unused networks... Trying to prune unused networks... Executing query drop workload C2; on node Executing query drop workload C2; on node Executing query SELECT * FROM `test_database`.`test_many_conc_4` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`test_many_conc_4` LIMIT 1 FORMAT Null on instance Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:9 Stdout:9 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 9 Volumes pruned: 9 ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3] ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV HOSTNAME 3624a24af23d ENV HOSTNAME 3624a24af23d ENV SHLVL 0 ENV SHLVL 0 ENV HOME /root ENV HOME /root ENV OLDPWD / ENV OLDPWD / ENV DOCKER_HELPER_TAG 5dc43a6382f0 ENV DOCKER_HELPER_TAG 5dc43a6382f0 ENV PYTHONUNBUFFERED 1 ENV PYTHONUNBUFFERED 1 ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e ENV UBSAN_OPTIONS print_stacktrace=1 ENV UBSAN_OPTIONS print_stacktrace=1 ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots test_postgresql_replica_database_engine_1/test.py::test_virtual_columns test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_remote_prewhere/test.py::test_remote test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16]' 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12]' test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replicated_user_defined_functions/test.py::test_create_and_drop 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1]' 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0]' test_replicated_user_defined_functions/test.py::test_create_and_replace test_replicated_user_defined_functions/test.py::test_drop_if_exists test_replicated_user_defined_functions/test.py::test_reload_zookeeper test_replicated_user_defined_functions/test.py::test_replication test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation test_replicated_user_defined_functions/test.py::test_server_restart test_replicated_user_defined_functions/test.py::test_start_without_zookeeper test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_s3_imds/test_session_token.py::test_credentials_from_metadata test_s3_imds/test_simple.py::test_credentials_from_metadata test_s3_latency_log/test.py::test_latency_log test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver]' test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy test_scheduler/test.py::test_create_workload test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_resource_any_disk test_scheduler/test.py::test_resource_read_and_write test_scheduler/test.py::test_s3_disk test_scheduler/test.py::test_s3_resource_request_granularity test_scheduler/test.py::test_throw_on_unknown_workload test_scheduler/test.py::test_workload_entity_keeper_storage test_scheduler/test.py::test_workload_hierarchy_changes test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings -vvv -ss ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots test_postgresql_replica_database_engine_1/test.py::test_virtual_columns test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_remote_prewhere/test.py::test_remote test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16]' 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12]' test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replicated_user_defined_functions/test.py::test_create_and_drop 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1]' 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0]' test_replicated_user_defined_functions/test.py::test_create_and_replace test_replicated_user_defined_functions/test.py::test_drop_if_exists test_replicated_user_defined_functions/test.py::test_reload_zookeeper test_replicated_user_defined_functions/test.py::test_replication test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation test_replicated_user_defined_functions/test.py::test_server_restart test_replicated_user_defined_functions/test.py::test_start_without_zookeeper test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_s3_imds/test_session_token.py::test_credentials_from_metadata test_s3_imds/test_simple.py::test_credentials_from_metadata test_s3_latency_log/test.py::test_latency_log test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver]' test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy test_scheduler/test.py::test_create_workload test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_resource_any_disk test_scheduler/test.py::test_resource_read_and_write test_scheduler/test.py::test_s3_disk test_scheduler/test.py::test_s3_resource_request_granularity test_scheduler/test.py::test_throw_on_unknown_workload test_scheduler/test.py::test_workload_entity_keeper_storage test_scheduler/test.py::test_workload_hierarchy_changes test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings -vvv -ss ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge ENV COMPOSE_HTTP_TIMEOUT 600 ENV COMPOSE_HTTP_TIMEOUT 600 ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_CHANNEL stable ENV DOCKER_CHANNEL stable ENV DOCKER_CLIENT_TIMEOUT 300 ENV DOCKER_CLIENT_TIMEOUT 300 ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV PWD /ClickHouse/tests/integration ENV PWD /ClickHouse/tests/integration ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV TZ Etc/UTC ENV TZ Etc/UTC ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV DOCKER_BASE_TAG 8b2301119731 ENV DOCKER_BASE_TAG 8b2301119731 ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV LC_CTYPE C.UTF-8 ENV LC_CTYPE C.UTF-8 ENV INTEGRATION_TESTS_RUN_ID 0 ENV INTEGRATION_TESTS_RUN_ID 0 ENV WORKER_FREE_PORTS 30200 30201 30202 30203 30204 30205 30206 30207 30208 30209 30210 30211 30212 30213 30214 30215 30216 30217 30218 30219 30220 30221 30222 30223 30224 30225 30226 30227 30228 30229 30230 30231 30232 30233 30234 30235 30236 30237 30238 30239 30240 30241 30242 30243 30244 30245 30246 30247 30248 30249 ENV WORKER_FREE_PORTS 30200 30201 30202 30203 30204 30205 30206 30207 30208 30209 30210 30211 30212 30213 30214 30215 30216 30217 30218 30219 30220 30221 30222 30223 30224 30225 30226 30227 30228 30229 30230 30231 30232 30233 30234 30235 30236 30237 30238 30239 30240 30241 30242 30243 30244 30245 30246 30247 30248 30249 ENV PYTEST_XDIST_TESTRUNUID c5ba503209524253afe87e95762d6d1b ENV PYTEST_XDIST_TESTRUNUID c5ba503209524253afe87e95762d6d1b ENV PYTEST_XDIST_WORKER gw4 ENV PYTEST_XDIST_WORKER gw4 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV SSL_CERT_FILE /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/minio/certs/public.crt ENV SSL_CERT_FILE /ClickHouse/tests/integration/test_s3_table_function_with_http_proxy/_instances-0-gw4/minio/certs/public.crt ENV PYTEST_CURRENT_TEST test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3] (setup) ENV PYTEST_CURRENT_TEST test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3] (setup) CLUSTER INIT base_config_dir:/clickhouse-config CLUSTER INIT base_config_dir:/clickhouse-config clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Cluster name: project_name:roottests3storageconfproxy-gw4. Added instance name:node tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/.env', '--project-name', 'roottests3storageconfproxy-gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottests3storageconfproxy-gw4. Added instance name:node tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/.env', '--project-name', 'roottests3storageconfproxy-gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Starting cluster... Starting cluster... Running tests in /ClickHouse/tests/integration/test_s3_storage_conf_proxy/test.py Running tests in /ClickHouse/tests/integration/test_s3_storage_conf_proxy/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottests3storageconfproxy-gw4 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3storageconfproxy-gw4 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3storageconfproxy-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3storageconfproxy-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3storageconfproxy-gw4 are DRIVER VOLUME NAME Docker volumes for project roottests3storageconfproxy-gw4 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottests3storageconfproxy-gw4 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3storageconfproxy-gw4 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3storageconfproxy-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3storageconfproxy-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3storageconfproxy-gw4 are DRIVER VOLUME NAME Docker volumes for project roottests3storageconfproxy-gw4 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3storageconfproxy-gw4-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3storageconfproxy-gw4-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3storageconfproxy-gw4 No running containers for project: roottests3storageconfproxy-gw4 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Executing query drop workload D1; on node Executing query drop workload D1; on node Stdout:9 Stdout:9 Command:[docker volume prune -f] Command:[docker volume prune -f] Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_many_conc_4' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_many_conc_4' on instance Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 9 Volumes pruned: 9 Setup directory for instance: node Setup directory for instance: node Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_s3_storage_conf_proxy/configs/config.d/storage_conf.xml'] to /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/node/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_s3_storage_conf_proxy/configs/config.d/storage_conf.xml'] to /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/node/configs/config.d Setup database dir /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/node/database Setup database dir /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/node/database Setup logs dir /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/node/logs Setup logs dir /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/node/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/.env --project-name roottests3storageconfproxy-gw4 --file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/.env --project-name roottests3storageconfproxy-gw4 --file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Executing query drop workload D2; on node Executing query drop workload D2; on node Executing query select * from `postgres_database`.`test_many_conc_4` order by key; on instance Executing query select * from `postgres_database`.`test_many_conc_4` order by key; on instance Executing query create workload Z in all; on node Executing query create workload Z in all; on node Executing query select * from `test_database`.`test_many_conc_4` order by key; on instance Executing query select * from `test_database`.`test_many_conc_4` order by key; on instance run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query create workload A1 in Z settings priority = -1; on node Executing query create workload A1 in Z settings priority = -1; on node Stdout:7872 Stdout:7872 Executing query SELECT count() FROM postgres_database.test_many_conc_4 on instance Executing query SELECT count() FROM postgres_database.test_many_conc_4 on instance Executing query create workload A2 in Z settings priority = -1; on node Executing query create workload A2 in Z settings priority = -1; on node http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/e1987cf438077148dfcd21430a0b5acd8fefd691170f2e55926bc0997c1224c2/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/e1987cf438077148dfcd21430a0b5acd8fefd691170f2e55926bc0997c1224c2/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/e1987cf438077148dfcd21430a0b5acd8fefd691170f2e55926bc0997c1224c2/json HTTP/1.1" 200 457 http://localhost:None "GET /v1.46/exec/e1987cf438077148dfcd21430a0b5acd8fefd691170f2e55926bc0997c1224c2/json HTTP/1.1" 200 457 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/0d17b3165f126ab48c1061316a560f2ec0b642a83a0d78122b51764014c2f9e3/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/0d17b3165f126ab48c1061316a560f2ec0b642a83a0d78122b51764014c2f9e3/start HTTP/1.1" 101 0 Executing query SELECT count() FROM (SELECT * FROM test_database.test_many_conc_4) on instance Executing query SELECT count() FROM (SELECT * FROM test_database.test_many_conc_4) on instance http://localhost:None "GET /v1.46/exec/0d17b3165f126ab48c1061316a560f2ec0b642a83a0d78122b51764014c2f9e3/json HTTP/1.1" 200 457 http://localhost:None "GET /v1.46/exec/0d17b3165f126ab48c1061316a560f2ec0b642a83a0d78122b51764014c2f9e3/json HTTP/1.1" 200 457 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance [gw0] PASSED test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:7872 Stdout:7872 Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 test_postgresql_replica_database_engine_1/test.py::test_multiple_databases Executing query DROP DATABASE IF EXISTS "postgres_database_1" on instance Executing query DROP DATABASE IF EXISTS "postgres_database_1" on instance run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query CREATE DATABASE "postgres_database_1" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database_1', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database_1" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database_1', 'postgres', 'mysecretpassword') on instance No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw5-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw5-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/be7327feb855057ea8e45b9d43b8b19da8843027e925b1a96ef007d1cba273d0/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/be7327feb855057ea8e45b9d43b8b19da8843027e925b1a96ef007d1cba273d0/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/be7327feb855057ea8e45b9d43b8b19da8843027e925b1a96ef007d1cba273d0/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/be7327feb855057ea8e45b9d43b8b19da8843027e925b1a96ef007d1cba273d0/json HTTP/1.1" 200 586 Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query DROP DATABASE IF EXISTS "postgres_database_2" on instance Executing query DROP DATABASE IF EXISTS "postgres_database_2" on instance Executing query CREATE DATABASE "postgres_database_2" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database_2', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database_2" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database_2', 'postgres', 'mysecretpassword') on instance Executing query select name, create_query from system.resources order by all on node Executing query select name, create_query from system.resources order by all on node Executing query INSERT INTO postgres_database_1.postgresql_replica_0 SELECT number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_1.postgresql_replica_0 SELECT number, number from numbers(50) on instance Executing query select name, create_query from system.resources order by all on node2 Executing query select name, create_query from system.resources order by all on node2 Executing query INSERT INTO postgres_database_1.postgresql_replica_1 SELECT number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_1.postgresql_replica_1 SELECT number, number from numbers(50) on instance Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8680 Stdout:8680 Clickhouse process running. Clickhouse process running. run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8680 Stdout:8680 Executing query select 20 on node Executing query select 20 on node Executing query INSERT INTO postgres_database_1.postgresql_replica_2 SELECT number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_1.postgresql_replica_2 SELECT number, number from numbers(50) on instance Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 Executing query INSERT INTO postgres_database_1.postgresql_replica_3 SELECT number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_1.postgresql_replica_3 SELECT number, number from numbers(50) on instance http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/d0d93de5973bcd6a9d1e847017c73f332b22a38902e2ef01fe24375883d2fd4c/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/d0d93de5973bcd6a9d1e847017c73f332b22a38902e2ef01fe24375883d2fd4c/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/d0d93de5973bcd6a9d1e847017c73f332b22a38902e2ef01fe24375883d2fd4c/json HTTP/1.1" 200 461 http://localhost:None "GET /v1.46/exec/d0d93de5973bcd6a9d1e847017c73f332b22a38902e2ef01fe24375883d2fd4c/json HTTP/1.1" 200 461 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/41546e0f518f3bae0eb7d926d8b064f80dcfccd80151239e3952b8f523ac36f1/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/41546e0f518f3bae0eb7d926d8b064f80dcfccd80151239e3952b8f523ac36f1/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/41546e0f518f3bae0eb7d926d8b064f80dcfccd80151239e3952b8f523ac36f1/json HTTP/1.1" 200 461 http://localhost:None "GET /v1.46/exec/41546e0f518f3bae0eb7d926d8b064f80dcfccd80151239e3952b8f523ac36f1/json HTTP/1.1" 200 461 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): Executing query create workload A3 in Z settings priority = -1; on node Executing query create workload A3 in Z settings priority = -1; on node Executing query select 20 on node Executing query select 20 on node Executing query INSERT INTO postgres_database_1.postgresql_replica_4 SELECT number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_1.postgresql_replica_4 SELECT number, number from numbers(50) on instance Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query create workload B1 in Z settings priority = 1; on node Executing query create workload B1 in Z settings priority = 1; on node Executing query INSERT INTO postgres_database_2.postgresql_replica_0 SELECT number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_2.postgresql_replica_0 SELECT number, number from numbers(50) on instance Executing query create workload B2 in Z settings priority = 1; on node Executing query create workload B2 in Z settings priority = 1; on node Executing query select 20 on node Executing query select 20 on node Executing query INSERT INTO postgres_database_2.postgresql_replica_1 SELECT number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_2.postgresql_replica_1 SELECT number, number from numbers(50) on instance Executing query create workload B3 in Z settings priority = 1; on node Executing query create workload B3 in Z settings priority = 1; on node Executing query INSERT INTO postgres_database_2.postgresql_replica_2 SELECT number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_2.postgresql_replica_2 SELECT number, number from numbers(50) on instance http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/021536cc699b133f19da5fc91687f83cab21c0053bb9cf41bbafded472247874/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/021536cc699b133f19da5fc91687f83cab21c0053bb9cf41bbafded472247874/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/021536cc699b133f19da5fc91687f83cab21c0053bb9cf41bbafded472247874/json HTTP/1.1" 200 457 http://localhost:None "GET /v1.46/exec/021536cc699b133f19da5fc91687f83cab21c0053bb9cf41bbafded472247874/json HTTP/1.1" 200 457 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/64f13451115171e8701c44149fe2e0192bc8cbb1129a08bfb12debd3c107f7b3/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/64f13451115171e8701c44149fe2e0192bc8cbb1129a08bfb12debd3c107f7b3/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/64f13451115171e8701c44149fe2e0192bc8cbb1129a08bfb12debd3c107f7b3/json HTTP/1.1" 200 457 http://localhost:None "GET /v1.46/exec/64f13451115171e8701c44149fe2e0192bc8cbb1129a08bfb12debd3c107f7b3/json HTTP/1.1" 200 457 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Executing query select 20 on node Executing query select 20 on node Executing query INSERT INTO postgres_database_2.postgresql_replica_3 SELECT number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_2.postgresql_replica_3 SELECT number, number from numbers(50) on instance Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); on node Executing query INSERT INTO postgres_database_2.postgresql_replica_4 SELECT number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_2.postgresql_replica_4 SELECT number, number from numbers(50) on instance Executing query SELECT name FROM system.tables WHERE database = 'postgres_database_1'; on instance Executing query SELECT name FROM system.tables WHERE database = 'postgres_database_1'; on instance Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/no_such_table_option/max_open_files/g' /etc/clickhouse-server/config.d/rocksdb.xml"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's/no_such_table_option/max_open_files/g' /etc/clickhouse-server/config.d/rocksdb.xml"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c sed -i 's/no_such_table_option/max_open_files/g' /etc/clickhouse-server/config.d/rocksdb.xml] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c sed -i 's/no_such_table_option/max_open_files/g' /etc/clickhouse-server/config.d/rocksdb.xml] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c ps -C clickhouse] Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 8680 ? 00:00:07 clickhouse Stdout: 8680 ? 00:00:07 clickhouse run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestrocksdboptions-gw5-node-1 bash -c pkill clickhouse] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8680 Stdout:8680 Stderr: Container roottestrenamecolumn-gw3-node1-1 Stopping Stderr: Container roottestrenamecolumn-gw3-node1-1 Stopping Stderr: Container roottestrenamecolumn-gw3-node2-1 Stopping Stderr: Container roottestrenamecolumn-gw3-node2-1 Stopping Stderr: Container roottestrenamecolumn-gw3-node3-1 Stopping Stderr: Container roottestrenamecolumn-gw3-node3-1 Stopping Stderr: Container roottestrenamecolumn-gw3-node4-1 Stopping Stderr: Container roottestrenamecolumn-gw3-node4-1 Stopping Stderr: Container roottestrenamecolumn-gw3-node3-1 Stopped Stderr: Container roottestrenamecolumn-gw3-node3-1 Stopped Stderr: Container roottestrenamecolumn-gw3-node2-1 Stopped Stderr: Container roottestrenamecolumn-gw3-node2-1 Stopped Stderr: Container roottestrenamecolumn-gw3-node4-1 Stopped Stderr: Container roottestrenamecolumn-gw3-node4-1 Stopped Stderr: Container roottestrenamecolumn-gw3-node1-1 Stopped Stderr: Container roottestrenamecolumn-gw3-node1-1 Stopped Stderr: Container roottestrenamecolumn-gw3-zoo1-1 Stopping Stderr: Container roottestrenamecolumn-gw3-zoo1-1 Stopping Stderr: Container roottestrenamecolumn-gw3-zoo2-1 Stopping Stderr: Container roottestrenamecolumn-gw3-zoo2-1 Stopping Stderr: Container roottestrenamecolumn-gw3-zoo3-1 Stopping Stderr: Container roottestrenamecolumn-gw3-zoo3-1 Stopping Stderr: Container roottestrenamecolumn-gw3-zoo1-1 Stopped Stderr: Container roottestrenamecolumn-gw3-zoo1-1 Stopped Stderr: Container roottestrenamecolumn-gw3-zoo3-1 Stopped Stderr: Container roottestrenamecolumn-gw3-zoo3-1 Stopped Stderr: Container roottestrenamecolumn-gw3-zoo2-1 Stopped Stderr: Container roottestrenamecolumn-gw3-zoo2-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node3/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node3/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node3/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node3/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node4/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node4/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node4/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node4/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/.env --project-name roottestrenamecolumn-gw3 --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node3/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node4/docker-compose.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/.env --project-name roottestrenamecolumn-gw3 --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node3/docker-compose.yml --file /ClickHouse/tests/integration/test_rename_column/_instances-0-gw3/node4/docker-compose.yml down --volumes] Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query SELECT name FROM system.tables WHERE database = 'postgres_database_2'; on instance Executing query SELECT name FROM system.tables WHERE database = 'postgres_database_2'; on instance Executing query select name, create_query from system.resources order by all on node Executing query select name, create_query from system.resources order by all on node Executing query DROP DATABASE IF EXISTS `test_database_1` on instance Executing query DROP DATABASE IF EXISTS `test_database_1` on instance Executing query CREATE DATABASE `test_database_1` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database_1', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database_1` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database_1', 'postgres', 'mysecretpassword') on instance Stderr: replica2 Skipped - Image is already being pulled by zoo2 Stderr: replica2 Skipped - Image is already being pulled by zoo2 Stderr: replica3 Skipped - Image is already being pulled by zoo2 Stderr: replica3 Skipped - Image is already being pulled by zoo2 Stderr: replica1 Skipped - Image is already being pulled by zoo2 Stderr: replica1 Skipped - Image is already being pulled by zoo2 Stderr: zoo3 Skipped - Image is already being pulled by zoo2 Stderr: zoo3 Skipped - Image is already being pulled by zoo2 Stderr: zoo1 Skipped - Image is already being pulled by zoo2 Stderr: zoo1 Skipped - Image is already being pulled by zoo2 Stderr: mysql80 Pulling Stderr: mysql80 Pulling Stderr: zoo2 Pulling Stderr: zoo2 Pulling Stderr: mysql80 Pulled Stderr: mysql80 Pulled Stderr: zoo2 Pulled Stderr: zoo2 Pulled Setup ZooKeeper Setup ZooKeeper Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper1/log', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper1/config', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper1/coordination', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper2/log', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper2/config', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper2/coordination', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper3/log', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper3/config', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper3/coordination'] Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper1/log', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper1/config', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper1/coordination', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper2/log', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper2/config', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper2/coordination', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper3/log', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper3/config', '/ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/keeper3/coordination'] Command:[docker compose --project-name roottestrestoreexternalengines-gw7 --env-file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Command:[docker compose --project-name roottestrestoreexternalengines-gw7 --env-file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Executing query select name, create_query from system.resources order by all on node2 Executing query select name, create_query from system.resources order by all on node2 Stderr: Container roottestrenamecolumn-gw3-node2-1 Stopping Stderr: Container roottestrenamecolumn-gw3-node2-1 Stopping Stderr: Container roottestrenamecolumn-gw3-node3-1 Stopping Stderr: Container roottestrenamecolumn-gw3-node3-1 Stopping Stderr: Container roottestrenamecolumn-gw3-node4-1 Stopping Stderr: Container roottestrenamecolumn-gw3-node4-1 Stopping Stderr: Container roottestrenamecolumn-gw3-node1-1 Stopping Stderr: Container roottestrenamecolumn-gw3-node1-1 Stopping Stderr: Container roottestrenamecolumn-gw3-node1-1 Stopped Stderr: Container roottestrenamecolumn-gw3-node1-1 Stopped Stderr: Container roottestrenamecolumn-gw3-node1-1 Removing Stderr: Container roottestrenamecolumn-gw3-node1-1 Removing Stderr: Container roottestrenamecolumn-gw3-node3-1 Stopped Stderr: Container roottestrenamecolumn-gw3-node3-1 Stopped Stderr: Container roottestrenamecolumn-gw3-node3-1 Removing Stderr: Container roottestrenamecolumn-gw3-node3-1 Removing Stderr: Container roottestrenamecolumn-gw3-node2-1 Stopped Stderr: Container roottestrenamecolumn-gw3-node2-1 Stopped Stderr: Container roottestrenamecolumn-gw3-node2-1 Removing Stderr: Container roottestrenamecolumn-gw3-node2-1 Removing Stderr: Container roottestrenamecolumn-gw3-node4-1 Stopped Stderr: Container roottestrenamecolumn-gw3-node4-1 Stopped Stderr: Container roottestrenamecolumn-gw3-node4-1 Removing Stderr: Container roottestrenamecolumn-gw3-node4-1 Removing Stderr: Container roottestrenamecolumn-gw3-node1-1 Removed Stderr: Container roottestrenamecolumn-gw3-node1-1 Removed Stderr: Container roottestrenamecolumn-gw3-node3-1 Removed Stderr: Container roottestrenamecolumn-gw3-node3-1 Removed Stderr: Container roottestrenamecolumn-gw3-node2-1 Removed Stderr: Container roottestrenamecolumn-gw3-node2-1 Removed Stderr: Container roottestrenamecolumn-gw3-node4-1 Removed Stderr: Container roottestrenamecolumn-gw3-node4-1 Removed Stderr: Container roottestrenamecolumn-gw3-zoo2-1 Stopping Stderr: Container roottestrenamecolumn-gw3-zoo2-1 Stopping Stderr: Container roottestrenamecolumn-gw3-zoo3-1 Stopping Stderr: Container roottestrenamecolumn-gw3-zoo3-1 Stopping Stderr: Container roottestrenamecolumn-gw3-zoo1-1 Stopping Stderr: Container roottestrenamecolumn-gw3-zoo1-1 Stopping Stderr: Container roottestrenamecolumn-gw3-zoo2-1 Stopped Stderr: Container roottestrenamecolumn-gw3-zoo2-1 Stopped Stderr: Container roottestrenamecolumn-gw3-zoo2-1 Removing Stderr: Container roottestrenamecolumn-gw3-zoo2-1 Removing Stderr: Container roottestrenamecolumn-gw3-zoo3-1 Stopped Stderr: Container roottestrenamecolumn-gw3-zoo3-1 Stopped Stderr: Container roottestrenamecolumn-gw3-zoo3-1 Removing Stderr: Container roottestrenamecolumn-gw3-zoo3-1 Removing Stderr: Container roottestrenamecolumn-gw3-zoo1-1 Stopped Stderr: Container roottestrenamecolumn-gw3-zoo1-1 Stopped Stderr: Container roottestrenamecolumn-gw3-zoo1-1 Removing Stderr: Container roottestrenamecolumn-gw3-zoo1-1 Removing Stderr: Container roottestrenamecolumn-gw3-zoo2-1 Removed Stderr: Container roottestrenamecolumn-gw3-zoo2-1 Removed Stderr: Container roottestrenamecolumn-gw3-zoo3-1 Removed Stderr: Container roottestrenamecolumn-gw3-zoo3-1 Removed Stderr: Container roottestrenamecolumn-gw3-zoo1-1 Removed Stderr: Container roottestrenamecolumn-gw3-zoo1-1 Removed Stderr: Network roottestrenamecolumn-gw3_default Removing Stderr: Network roottestrenamecolumn-gw3_default Removing Stderr: Network roottestrenamecolumn-gw3_default Removed Stderr: Network roottestrenamecolumn-gw3_default Removed Cleanup called Cleanup called Docker networks for project roottestrenamecolumn-gw3 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestrenamecolumn-gw3 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestrenamecolumn-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestrenamecolumn-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestrenamecolumn-gw3 are DRIVER VOLUME NAME Docker volumes for project roottestrenamecolumn-gw3 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestrenamecolumn-gw3-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestrenamecolumn-gw3-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestrenamecolumn-gw3 No running containers for project: roottestrenamecolumn-gw3 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:9 Stdout:9 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 9 Volumes pruned: 9 clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Setup Keeper Setup Keeper Cluster name: project_name:roottestreplicatedmergetreereplicateddbttl-gw3. Added instance name:node1 tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl-gw3', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottestreplicatedmergetreereplicateddbttl-gw3. Added instance name:node1 tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl-gw3', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Running tests in /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/test.py Running tests in /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/test.py Cluster start called. is_up=False Cluster start called. is_up=False test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl Docker networks for project roottestreplicatedmergetreereplicateddbttl-gw3 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedmergetreereplicateddbttl-gw3 are NETWORK ID NAME DRIVER SCOPE Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance Docker containers for project roottestreplicatedmergetreereplicateddbttl-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedmergetreereplicateddbttl-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Docker volumes for project roottestreplicatedmergetreereplicateddbttl-gw3 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedmergetreereplicateddbttl-gw3 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottestreplicatedmergetreereplicateddbttl-gw3 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedmergetreereplicateddbttl-gw3 are NETWORK ID NAME DRIVER SCOPE Stdout:8680 Stdout:8680 Docker containers for project roottestreplicatedmergetreereplicateddbttl-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedmergetreereplicateddbttl-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node Docker volumes for project roottestreplicatedmergetreereplicateddbttl-gw3 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedmergetreereplicateddbttl-gw3 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreplicatedmergetreereplicateddbttl-gw3-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreplicatedmergetreereplicateddbttl-gw3-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicatedmergetreereplicateddbttl-gw3 No running containers for project: roottestreplicatedmergetreereplicateddbttl-gw3 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:9 Stdout:9 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 9 Volumes pruned: 9 Setup directory for instance: node1 Setup directory for instance: node1 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/configs/node1_macro.xml'] to /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/configs/node1_macro.xml'] to /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/configs/config.d Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/database Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/database Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/logs Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: resolver Pulling Stderr: resolver Pulling Stderr: minio1 Pulling Stderr: minio1 Pulling Stderr: proxy1 Pulling Stderr: proxy1 Pulling Stderr: node Pulling Stderr: node Pulling Stderr: resolver Pulled Stderr: resolver Pulled Stderr: minio1 Pulled Stderr: minio1 Pulled Stderr: proxy1 Pulled Stderr: proxy1 Pulled Stderr: node Pulled Stderr: node Pulled Trying to create Minio instance by command docker compose --project-name roottests3storageconfproxy-gw4 --env-file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Trying to create Minio instance by command docker compose --project-name roottests3storageconfproxy-gw4 --env-file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Command:[docker compose --project-name roottests3storageconfproxy-gw4 --env-file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Command:[docker compose --project-name roottests3storageconfproxy-gw4 --env-file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Executing query DROP DATABASE IF EXISTS `test_database_2` on instance Executing query DROP DATABASE IF EXISTS `test_database_2` on instance Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 Stderr:time="2025-04-02T02:55:03Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:55:03Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestrestoreexternalengines-gw7_default Creating Stderr: Network roottestrestoreexternalengines-gw7_default Creating Stderr: Network roottestrestoreexternalengines-gw7_default Created Stderr: Network roottestrestoreexternalengines-gw7_default Created Stderr: Container roottestrestoreexternalengines-gw7-zoo3-1 Creating Stderr: Container roottestrestoreexternalengines-gw7-zoo3-1 Creating Stderr: Container roottestrestoreexternalengines-gw7-zoo1-1 Creating Stderr: Container roottestrestoreexternalengines-gw7-zoo1-1 Creating Stderr: Container roottestrestoreexternalengines-gw7-zoo2-1 Creating Stderr: Container roottestrestoreexternalengines-gw7-zoo2-1 Creating Stderr: Container roottestrestoreexternalengines-gw7-zoo1-1 Created Stderr: Container roottestrestoreexternalengines-gw7-zoo1-1 Created Stderr: Container roottestrestoreexternalengines-gw7-zoo2-1 Created Stderr: Container roottestrestoreexternalengines-gw7-zoo2-1 Created Stderr: Container roottestrestoreexternalengines-gw7-zoo3-1 Created Stderr: Container roottestrestoreexternalengines-gw7-zoo3-1 Created Stderr: Container roottestrestoreexternalengines-gw7-zoo1-1 Starting Stderr: Container roottestrestoreexternalengines-gw7-zoo1-1 Starting Stderr: Container roottestrestoreexternalengines-gw7-zoo2-1 Starting Stderr: Container roottestrestoreexternalengines-gw7-zoo2-1 Starting Stderr: Container roottestrestoreexternalengines-gw7-zoo3-1 Starting Stderr: Container roottestrestoreexternalengines-gw7-zoo3-1 Starting Stderr: Container roottestrestoreexternalengines-gw7-zoo2-1 Started Stderr: Container roottestrestoreexternalengines-gw7-zoo2-1 Started Stderr: Container roottestrestoreexternalengines-gw7-zoo3-1 Started Stderr: Container roottestrestoreexternalengines-gw7-zoo3-1 Started Stderr: Container roottestrestoreexternalengines-gw7-zoo1-1 Started Stderr: Container roottestrestoreexternalengines-gw7-zoo1-1 Started Stderr:time="2025-04-02T02:55:04Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:04Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:04Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:04Z" level=debug msg="otel error" error="" Wait ZooKeeper to start Wait ZooKeeper to start get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw7-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw7-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.3.2, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.3.2, port:2181, use_ssl:False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopped run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] No clickhouse process running. Start new one. No clickhouse process running. Start new one. Executing query CREATE DATABASE `test_database_2` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database_2', 'postgres', 'mysecretpassword') on instance http://localhost:None "POST /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node2-1/exec HTTP/1.1" 201 74 Executing query CREATE DATABASE `test_database_2` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database_2', 'postgres', 'mysecretpassword') on instance http://localhost:None "POST /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-node2-1/exec HTTP/1.1" 201 74 Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "POST /v1.46/exec/975551bc9ea604f39783a15ea3d0c0a149a8c14f4f2c7b5442c4f70a89fc2d3b/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/975551bc9ea604f39783a15ea3d0c0a149a8c14f4f2c7b5442c4f70a89fc2d3b/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/975551bc9ea604f39783a15ea3d0c0a149a8c14f4f2c7b5442c4f70a89fc2d3b/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/975551bc9ea604f39783a15ea3d0c0a149a8c14f4f2c7b5442c4f70a89fc2d3b/json HTTP/1.1" 200 586 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/d3cc121c4ecf520a0dd6aff97769baa52b5ccad015a1d20af0af0bbce0533b29/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/d3cc121c4ecf520a0dd6aff97769baa52b5ccad015a1d20af0af0bbce0533b29/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/d3cc121c4ecf520a0dd6aff97769baa52b5ccad015a1d20af0af0bbce0533b29/json HTTP/1.1" 200 461 http://localhost:None "GET /v1.46/exec/d3cc121c4ecf520a0dd6aff97769baa52b5ccad015a1d20af0af0bbce0533b29/json HTTP/1.1" 200 461 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/1cd684adb5bb793a65529f8860902db5dae03d24ee4f189b7bc4375d30ca81f1/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/1cd684adb5bb793a65529f8860902db5dae03d24ee4f189b7bc4375d30ca81f1/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/1cd684adb5bb793a65529f8860902db5dae03d24ee4f189b7bc4375d30ca81f1/json HTTP/1.1" 200 461 http://localhost:None "GET /v1.46/exec/1cd684adb5bb793a65529f8860902db5dae03d24ee4f189b7bc4375d30ca81f1/json HTTP/1.1" 200 461 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): Executing query create workload C1 in X settings priority = -1; on node Executing query create workload C1 in X settings priority = -1; on node Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance Executing query create workload C2 in X settings priority = -1; on node Executing query create workload C2 in X settings priority = -1; on node run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8680 Stdout:8680 Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query create workload C3 in X settings priority = -1; on node Executing query create workload C3 in X settings priority = -1; on node Executing query INSERT INTO postgres_database_1.postgresql_replica_0 SELECT 50 + number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_1.postgresql_replica_0 SELECT 50 + number, number from numbers(50) on instance Stderr:time="2025-04-02T02:55:04Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:55:04Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottests3storageconfproxy-gw4_default Creating Stderr: Network roottests3storageconfproxy-gw4_default Creating Stderr: Network roottests3storageconfproxy-gw4_default Created Stderr: Network roottests3storageconfproxy-gw4_default Created Stderr: Volume "roottests3storageconfproxy-gw4_data1-1" Creating Stderr: Volume "roottests3storageconfproxy-gw4_data1-1" Creating Stderr: Volume "roottests3storageconfproxy-gw4_data1-1" Created Stderr: Volume "roottests3storageconfproxy-gw4_data1-1" Created Stderr: Container roottests3storageconfproxy-gw4-proxy2-1 Creating Stderr: Container roottests3storageconfproxy-gw4-proxy2-1 Creating Stderr: Container roottests3storageconfproxy-gw4-proxy1-1 Creating Stderr: Container roottests3storageconfproxy-gw4-proxy1-1 Creating Stderr: Container roottests3storageconfproxy-gw4-proxy2-1 Created Stderr: Container roottests3storageconfproxy-gw4-proxy2-1 Created Stderr: Container roottests3storageconfproxy-gw4-proxy1-1 Created Stderr: Container roottests3storageconfproxy-gw4-proxy1-1 Created Stderr: Container roottests3storageconfproxy-gw4-minio1-1 Creating Stderr: Container roottests3storageconfproxy-gw4-minio1-1 Creating Stderr: Container roottests3storageconfproxy-gw4-resolver-1 Creating Stderr: Container roottests3storageconfproxy-gw4-resolver-1 Creating Stderr: Container roottests3storageconfproxy-gw4-resolver-1 Created Stderr: Container roottests3storageconfproxy-gw4-resolver-1 Created Stderr: Container roottests3storageconfproxy-gw4-minio1-1 Created Stderr: Container roottests3storageconfproxy-gw4-minio1-1 Created Stderr: Container roottests3storageconfproxy-gw4-proxy2-1 Starting Stderr: Container roottests3storageconfproxy-gw4-proxy2-1 Starting Stderr: Container roottests3storageconfproxy-gw4-proxy1-1 Starting Stderr: Container roottests3storageconfproxy-gw4-proxy1-1 Starting Stderr: Container roottests3storageconfproxy-gw4-proxy1-1 Started Stderr: Container roottests3storageconfproxy-gw4-proxy1-1 Started Stderr: Container roottests3storageconfproxy-gw4-proxy2-1 Started Stderr: Container roottests3storageconfproxy-gw4-proxy2-1 Started Stderr: Container roottests3storageconfproxy-gw4-minio1-1 Starting Stderr: Container roottests3storageconfproxy-gw4-minio1-1 Starting Stderr: Container roottests3storageconfproxy-gw4-resolver-1 Starting Stderr: Container roottests3storageconfproxy-gw4-resolver-1 Starting Stderr: Container roottests3storageconfproxy-gw4-minio1-1 Started Stderr: Container roottests3storageconfproxy-gw4-minio1-1 Started Stderr: Container roottests3storageconfproxy-gw4-resolver-1 Started Stderr: Container roottests3storageconfproxy-gw4-resolver-1 Started Stderr:time="2025-04-02T02:55:05Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:05Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:05Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:05Z" level=debug msg="otel error" error="" Trying to connect to Minio... Trying to connect to Minio... get_instance_ip instance_name=minio1 get_instance_ip instance_name=minio1 http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-minio1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-minio1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy1 get_instance_ip instance_name=proxy1 http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Starting new HTTP connection (1): 172.16.6.4:9001 Starting new HTTP connection (1): 172.16.6.4:9001 Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (2): 172.16.6.4:9001 Starting new HTTP connection (2): 172.16.6.4:9001 Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (3): 172.16.6.4:9001 Starting new HTTP connection (3): 172.16.6.4:9001 Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (4): 172.16.6.4:9001 Starting new HTTP connection (4): 172.16.6.4:9001 Can't connect to Minio: HTTPConnectionPool(host='172.16.6.4', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Can't connect to Minio: HTTPConnectionPool(host='172.16.6.4', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Executing query create workload D1 in X settings priority = 1; on node Executing query create workload D1 in X settings priority = 1; on node run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query INSERT INTO postgres_database_1.postgresql_replica_1 SELECT 50 + number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_1.postgresql_replica_1 SELECT 50 + number, number from numbers(50) on instance Stdout:790 Stdout:790 Clickhouse process running. Clickhouse process running. run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:790 Stdout:790 Executing query select 20 on node2 Executing query select 20 on node2 Executing query create workload D2 in X settings priority = 1; on node Executing query create workload D2 in X settings priority = 1; on node Executing query INSERT INTO postgres_database_1.postgresql_replica_2 SELECT 50 + number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_1.postgresql_replica_2 SELECT 50 + number, number from numbers(50) on instance Executing query create workload D3 in X settings priority = 1; on node Executing query create workload D3 in X settings priority = 1; on node Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8680 Stdout:8680 Executing query INSERT INTO postgres_database_1.postgresql_replica_3 SELECT 50 + number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_1.postgresql_replica_3 SELECT 50 + number, number from numbers(50) on instance Executing query drop workload A1; on node Executing query drop workload A1; on node Executing query select 20 on node2 Executing query select 20 on node2 Executing query drop workload B1; on node Executing query drop workload B1; on node Executing query INSERT INTO postgres_database_1.postgresql_replica_4 SELECT 50 + number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_1.postgresql_replica_4 SELECT 50 + number, number from numbers(50) on instance Starting new HTTP connection (5): 172.16.6.4:9001 Starting new HTTP connection (5): 172.16.6.4:9001 http://172.16.6.4:9001 "GET / HTTP/1.1" 200 0 http://172.16.6.4:9001 "GET / HTTP/1.1" 200 0 Connected to Minio. Connected to Minio. http://172.16.6.4:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.6.4:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.6.4:9001 "PUT /root HTTP/1.1" 200 0 http://172.16.6.4:9001 "PUT /root HTTP/1.1" 200 0 S3 bucket 'root' created S3 bucket 'root' created http://172.16.6.4:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.6.4:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.6.4:9001 "PUT /root2 HTTP/1.1" 200 0 http://172.16.6.4:9001 "PUT /root2 HTTP/1.1" 200 0 S3 bucket 'root2' created S3 bucket 'root2' created ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/.env --project-name roottests3storageconfproxy-gw4 --file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/.env --project-name roottests3storageconfproxy-gw4 --file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/.env --project-name roottests3storageconfproxy-gw4 --file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/.env --project-name roottests3storageconfproxy-gw4 --file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Executing query drop workload C1; on node Executing query drop workload C1; on node Executing query INSERT INTO postgres_database_2.postgresql_replica_0 SELECT 50 + number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_2.postgresql_replica_0 SELECT 50 + number, number from numbers(50) on instance Stderr: Container roottests3storageconfproxy-gw4-proxy2-1 Running Stderr: Container roottests3storageconfproxy-gw4-proxy2-1 Running Stderr: Container roottests3storageconfproxy-gw4-proxy1-1 Running Stderr: Container roottests3storageconfproxy-gw4-proxy1-1 Running Stderr: Container roottests3storageconfproxy-gw4-minio1-1 Running Stderr: Container roottests3storageconfproxy-gw4-minio1-1 Running Stderr: Container roottests3storageconfproxy-gw4-resolver-1 Running Stderr: Container roottests3storageconfproxy-gw4-resolver-1 Running Stderr: Container roottests3storageconfproxy-gw4-node-1 Creating Stderr: Container roottests3storageconfproxy-gw4-node-1 Creating Stderr: Container roottests3storageconfproxy-gw4-node-1 Created Stderr: Container roottests3storageconfproxy-gw4-node-1 Created Stderr: Container roottests3storageconfproxy-gw4-node-1 Starting Stderr: Container roottests3storageconfproxy-gw4-node-1 Starting Stderr: Container roottests3storageconfproxy-gw4-node-1 Started Stderr: Container roottests3storageconfproxy-gw4-node-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-node-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-node-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node, ip: 172.16.6.6... Waiting for ClickHouse start in node, ip: 172.16.6.6... http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None Executing query drop workload D1; on node Executing query drop workload D1; on node http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None Executing query select 20 on node2 Executing query select 20 on node2 Executing query INSERT INTO postgres_database_2.postgresql_replica_1 SELECT 50 + number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_2.postgresql_replica_1 SELECT 50 + number, number from numbers(50) on instance http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query drop workload A2; on node Executing query drop workload A2; on node Stdout:8680 Stdout:8680 http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database_2.postgresql_replica_2 SELECT 50 + number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_2.postgresql_replica_2 SELECT 50 + number, number from numbers(50) on instance Executing query drop workload B2; on node Executing query drop workload B2; on node http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None Executing query drop workload C2; on node Executing query drop workload C2; on node Executing query select 20 on node2 Executing query select 20 on node2 http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database_2.postgresql_replica_3 SELECT 50 + number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_2.postgresql_replica_3 SELECT 50 + number, number from numbers(50) on instance http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node2-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node2-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-resolver-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-resolver-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node3-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node3-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node1-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node1-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-minio1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-minio1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-minio1-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-minio1-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node2-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node2-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node3-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node3-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo3-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo3-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo1-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo1-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-resolver-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-resolver-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy2-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy2-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy2-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy2-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy1-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy1-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Executing query drop workload D2; on node Executing query drop workload D2; on node Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node3/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node3/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node3/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node3/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Executing query INSERT INTO postgres_database_2.postgresql_replica_4 SELECT 50 + number, number from numbers(50) on instance Executing query INSERT INTO postgres_database_2.postgresql_replica_4 SELECT 50 + number, number from numbers(50) on instance Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/.env --project-name roottestreplicatedmergetrees3zerocopy-gw6 --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node3/docker-compose.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/.env --project-name roottestreplicatedmergetrees3zerocopy-gw6 --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_s3_zero_copy/_instances-0-gw6/node3/docker-compose.yml down --volumes] http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query drop workload A3; on node Executing query drop workload A3; on node No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw5-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestrocksdboptions-gw5-node-1/exec HTTP/1.1" 201 74 Executing query SELECT * FROM `test_database_1`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database_1`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance http://localhost:None "POST /v1.46/exec/dd9c2912567a184cbe66e93cd0e4b93806734c450324353772ddea7b1300662e/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/dd9c2912567a184cbe66e93cd0e4b93806734c450324353772ddea7b1300662e/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/dd9c2912567a184cbe66e93cd0e4b93806734c450324353772ddea7b1300662e/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/dd9c2912567a184cbe66e93cd0e4b93806734c450324353772ddea7b1300662e/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None Executing query select 20 on node2 Executing query select 20 on node2 Executing query drop workload B3; on node Executing query drop workload B3; on node http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None Executing query SHOW TABLES FROM `test_database_1` WHERE name = 'postgresql_replica_0' on instance Executing query SHOW TABLES FROM `test_database_1` WHERE name = 'postgresql_replica_0' on instance http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None Executing query drop workload C3; on node Executing query drop workload C3; on node http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node3-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node3-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-resolver-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-resolver-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node2-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node2-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node3-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node3-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node3-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node3-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-resolver-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-resolver-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-resolver-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-resolver-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node2-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node2-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node2-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node2-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node1-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node1-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node1-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node1-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-resolver-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-resolver-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node2-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node2-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node3-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node3-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node1-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-node1-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-minio1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-minio1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-minio1-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-minio1-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-minio1-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-minio1-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo2-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo2-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo3-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo3-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo3-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo3-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo1-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo1-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo1-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo1-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo2-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo2-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo3-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo3-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo1-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-zoo1-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-minio1-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-minio1-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy2-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy2-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy1-1 Stopping Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy2-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy2-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy2-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy2-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy1-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy1-1 Stopped Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy1-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy1-1 Removing Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy2-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy2-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy1-1 Removed Stderr: Container roottestreplicatedmergetrees3zerocopy-gw6-proxy1-1 Removed Stderr: Volume roottestreplicatedmergetrees3zerocopy-gw6_data1-1 Removing Stderr: Volume roottestreplicatedmergetrees3zerocopy-gw6_data1-1 Removing Stderr: Network roottestreplicatedmergetrees3zerocopy-gw6_default Removing Stderr: Network roottestreplicatedmergetrees3zerocopy-gw6_default Removing Stderr: Volume roottestreplicatedmergetrees3zerocopy-gw6_data1-1 Removed Stderr: Volume roottestreplicatedmergetrees3zerocopy-gw6_data1-1 Removed Stderr: Network roottestreplicatedmergetrees3zerocopy-gw6_default Removed Stderr: Network roottestreplicatedmergetrees3zerocopy-gw6_default Removed Cleanup called Cleanup called Executing query select * from `postgres_database_1`.`postgresql_replica_0` order by key; on instance Executing query select * from `postgres_database_1`.`postgresql_replica_0` order by key; on instance http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None Docker networks for project roottestreplicatedmergetrees3zerocopy-gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedmergetrees3zerocopy-gw6 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicatedmergetrees3zerocopy-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedmergetrees3zerocopy-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Executing query drop workload D3; on node Executing query drop workload D3; on node Docker volumes for project roottestreplicatedmergetrees3zerocopy-gw6 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedmergetrees3zerocopy-gw6 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreplicatedmergetrees3zerocopy-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreplicatedmergetrees3zerocopy-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicatedmergetrees3zerocopy-gw6 No running containers for project: roottestreplicatedmergetrees3zerocopy-gw6 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:9 Stdout:9 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 9 Volumes pruned: 9 test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers Running tests in /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/test.py Running tests in /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottestreloadauxiliaryzookeepers-gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreloadauxiliaryzookeepers-gw6 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreloadauxiliaryzookeepers-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreloadauxiliaryzookeepers-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreloadauxiliaryzookeepers-gw6 are DRIVER VOLUME NAME Docker volumes for project roottestreloadauxiliaryzookeepers-gw6 are DRIVER VOLUME NAME Cleanup called Cleanup called http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None Docker networks for project roottestreloadauxiliaryzookeepers-gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreloadauxiliaryzookeepers-gw6 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreloadauxiliaryzookeepers-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreloadauxiliaryzookeepers-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreloadauxiliaryzookeepers-gw6 are DRIVER VOLUME NAME Docker volumes for project roottestreloadauxiliaryzookeepers-gw6 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreloadauxiliaryzookeepers-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreloadauxiliaryzookeepers-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Executing query select * from `test_database_1`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database_1`.`postgresql_replica_0` order by key; on instance Executing query drop workload X; on node Executing query drop workload X; on node Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreloadauxiliaryzookeepers-gw6 No running containers for project: roottestreloadauxiliaryzookeepers-gw6 Trying to prune unused networks... Trying to prune unused networks... Executing query select 20 on node2 Executing query select 20 on node2 Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None Stdout:9 Stdout:9 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 9 Volumes pruned: 9 Setup directory for instance: node Setup directory for instance: node Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files [] to /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/node/configs/config.d Copy custom test config files [] to /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/node/configs/config.d Setup database dir /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/node/database Setup database dir /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/node/database Setup logs dir /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/node/logs Setup logs dir /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/node/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/.env --project-name roottestreloadauxiliaryzookeepers-gw6 --file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/.env --project-name roottestreloadauxiliaryzookeepers-gw6 --file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml pull] http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/c8ec6c0e9e1322fadc6e9746ad715c75724877719f7b698cd1398e4d193f2914/json HTTP/1.1" 200 None ClickHouse node started ClickHouse node started Cluster started Cluster started run container_id:roottests3storageconfproxy-gw4-resolver-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname resolver.py) && echo aW1wb3J0IHJhbmRvbQoKaW1wb3J0IGJvdHRsZQoKCkBib3R0bGUucm91dGUoIi9ob3N0bmFtZSIpCmRlZiBpbmRleCgpOgogICAgaWYgcmFuZG9tLnJhbmRyYW5nZSgyKSA9PSAwOgogICAgICAgIHJldHVybiAicHJveHkxIgogICAgZWxzZToKICAgICAgICByZXR1cm4gInByb3h5MiIKCgpib3R0bGUucnVuKGhvc3Q9IjAuMC4wLjAiLCBwb3J0PTgwODApCg== | base64 --decode > resolver.py'] run container_id:roottests3storageconfproxy-gw4-resolver-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname resolver.py) && echo aW1wb3J0IHJhbmRvbQoKaW1wb3J0IGJvdHRsZQoKCkBib3R0bGUucm91dGUoIi9ob3N0bmFtZSIpCmRlZiBpbmRleCgpOgogICAgaWYgcmFuZG9tLnJhbmRyYW5nZSgyKSA9PSAwOgogICAgICAgIHJldHVybiAicHJveHkxIgogICAgZWxzZToKICAgICAgICByZXR1cm4gInByb3h5MiIKCgpib3R0bGUucnVuKGhvc3Q9IjAuMC4wLjAiLCBwb3J0PTgwODApCg== | base64 --decode > resolver.py'] Command:[docker exec roottests3storageconfproxy-gw4-resolver-1 bash -c mkdir -p $(dirname resolver.py) && echo aW1wb3J0IHJhbmRvbQoKaW1wb3J0IGJvdHRsZQoKCkBib3R0bGUucm91dGUoIi9ob3N0bmFtZSIpCmRlZiBpbmRleCgpOgogICAgaWYgcmFuZG9tLnJhbmRyYW5nZSgyKSA9PSAwOgogICAgICAgIHJldHVybiAicHJveHkxIgogICAgZWxzZToKICAgICAgICByZXR1cm4gInByb3h5MiIKCgpib3R0bGUucnVuKGhvc3Q9IjAuMC4wLjAiLCBwb3J0PTgwODApCg== | base64 --decode > resolver.py] Command:[docker exec roottests3storageconfproxy-gw4-resolver-1 bash -c mkdir -p $(dirname resolver.py) && echo aW1wb3J0IHJhbmRvbQoKaW1wb3J0IGJvdHRsZQoKCkBib3R0bGUucm91dGUoIi9ob3N0bmFtZSIpCmRlZiBpbmRleCgpOgogICAgaWYgcmFuZG9tLnJhbmRyYW5nZSgyKSA9PSAwOgogICAgICAgIHJldHVybiAicHJveHkxIgogICAgZWxzZToKICAgICAgICByZXR1cm4gInByb3h5MiIKCgpib3R0bGUucnVuKGhvc3Q9IjAuMC4wLjAiLCBwb3J0PTgwODApCg== | base64 --decode > resolver.py] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottests3storageconfproxy-gw4-resolver-1 detach:True nothrow:False cmd: ['python', 'resolver.py'] run container_id:roottests3storageconfproxy-gw4-resolver-1 detach:True nothrow:False cmd: ['python', 'resolver.py'] Command:[docker exec roottests3storageconfproxy-gw4-resolver-1 python resolver.py] Command:[docker exec roottests3storageconfproxy-gw4-resolver-1 python resolver.py] run container_id:roottests3storageconfproxy-gw4-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/hostname'] run container_id:roottests3storageconfproxy-gw4-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/hostname'] Command:[docker exec roottests3storageconfproxy-gw4-resolver-1 curl -s http://resolver:8080/hostname] Command:[docker exec roottests3storageconfproxy-gw4-resolver-1 curl -s http://resolver:8080/hostname] Stdout:9489 Stdout:9489 Clickhouse process running. Clickhouse process running. run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrocksdboptions-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrocksdboptions-gw5-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query drop workload Y; on node Executing query drop workload Y; on node Stdout:9489 Stdout:9489 Executing query select 20 on node Executing query select 20 on node Exitcode:7 Exitcode:7 run container_id:roottests3storageconfproxy-gw4-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/hostname'] run container_id:roottests3storageconfproxy-gw4-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/hostname'] Command:[docker exec roottests3storageconfproxy-gw4-resolver-1 curl -s http://resolver:8080/hostname] Command:[docker exec roottests3storageconfproxy-gw4-resolver-1 curl -s http://resolver:8080/hostname] Executing query SELECT * FROM `test_database_1`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database_1`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Exitcode:7 Exitcode:7 Executing query drop workload Z; on node Executing query drop workload Z; on node Executing query SHOW TABLES FROM `test_database_1` WHERE name = 'postgresql_replica_1' on instance Executing query SHOW TABLES FROM `test_database_1` WHERE name = 'postgresql_replica_1' on instance Executing query select 20 on node2 Executing query select 20 on node2 Executing query drop workload all; on node Executing query drop workload all; on node Executing query select * from `postgres_database_1`.`postgresql_replica_1` order by key; on instance Executing query select * from `postgres_database_1`.`postgresql_replica_1` order by key; on instance Executing query select 20 on node Executing query select 20 on node http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/ff8cce2655af1254e4fc7dcccf1e89c1a860535cedc0085ac43d32f32d6b1f7b/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/ff8cce2655af1254e4fc7dcccf1e89c1a860535cedc0085ac43d32f32d6b1f7b/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/ff8cce2655af1254e4fc7dcccf1e89c1a860535cedc0085ac43d32f32d6b1f7b/json HTTP/1.1" 200 457 http://localhost:None "GET /v1.46/exec/ff8cce2655af1254e4fc7dcccf1e89c1a860535cedc0085ac43d32f32d6b1f7b/json HTTP/1.1" 200 457 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/6b9a4d50a2747de0e9176d064e428478ea9d6f0f042988dccda50f5c10f62f0d/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/6b9a4d50a2747de0e9176d064e428478ea9d6f0f042988dccda50f5c10f62f0d/start HTTP/1.1" 101 0 Executing query select * from `test_database_1`.`postgresql_replica_1` order by key; on instance Executing query select * from `test_database_1`.`postgresql_replica_1` order by key; on instance http://localhost:None "GET /v1.46/exec/6b9a4d50a2747de0e9176d064e428478ea9d6f0f042988dccda50f5c10f62f0d/json HTTP/1.1" 200 457 http://localhost:None "GET /v1.46/exec/6b9a4d50a2747de0e9176d064e428478ea9d6f0f042988dccda50f5c10f62f0d/json HTTP/1.1" 200 457 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Executing query select 20 on node2 Executing query select 20 on node2 run container_id:roottests3storageconfproxy-gw4-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/hostname'] run container_id:roottests3storageconfproxy-gw4-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/hostname'] Command:[docker exec roottests3storageconfproxy-gw4-resolver-1 curl -s http://resolver:8080/hostname] Command:[docker exec roottests3storageconfproxy-gw4-resolver-1 curl -s http://resolver:8080/hostname] Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query SELECT * FROM `test_database_1`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database_1`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Stdout:proxy1 Stdout:proxy1 Proxy resolver started Proxy resolver started Executing query CREATE TABLE s3_test ( id Int64, data String ) ENGINE=MergeTree() ORDER BY id SETTINGS storage_policy='s3' on node Executing query CREATE TABLE s3_test ( id Int64, data String ) ENGINE=MergeTree() ORDER BY id SETTINGS storage_policy='s3' on node Executing query select 20 on node Executing query select 20 on node Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Executing query INSERT INTO s3_test VALUES (0,'data'),(1,'data') on node Executing query INSERT INTO s3_test VALUES (0,'data'),(1,'data') on node Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Executing query SHOW TABLES FROM `test_database_1` WHERE name = 'postgresql_replica_2' on instance Executing query SHOW TABLES FROM `test_database_1` WHERE name = 'postgresql_replica_2' on instance Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw7-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw7-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.3.3, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.3.3, port:2181, use_ssl:False Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw7-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw7-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.3.4, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.3.4, port:2181, use_ssl:False Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Executing query select * from `postgres_database_1`.`postgresql_replica_2` order by key; on instance Executing query select * from `postgres_database_1`.`postgresql_replica_2` order by key; on instance Executing query SELECT * FROM s3_test order by id FORMAT Values on node Executing query SELECT * FROM s3_test order by id FORMAT Values on node Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') Setup MySQL 8 Setup MySQL 8 Command:[docker compose --project-name roottestrestoreexternalengines-gw7 --env-file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_mysql_8_0.yml --verbose up -d] Command:[docker compose --project-name roottestrestoreexternalengines-gw7 --env-file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_mysql_8_0.yml --verbose up -d] Executing query select 20 on node2 Executing query select 20 on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query select * from `test_database_1`.`postgresql_replica_2` order by key; on instance Executing query select * from `test_database_1`.`postgresql_replica_2` order by key; on instance Executing query DROP TABLE IF EXISTS s3_test SYNC on node Executing query DROP TABLE IF EXISTS s3_test SYNC on node Executing query select 20 on node Executing query select 20 on node Stderr:time="2025-04-02T02:55:11Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:55:11Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:55:11Z" level=warning msg="Found orphan containers ([roottestrestoreexternalengines-gw7-zoo2-1 roottestrestoreexternalengines-gw7-zoo1-1 roottestrestoreexternalengines-gw7-zoo3-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up." Stderr:time="2025-04-02T02:55:11Z" level=warning msg="Found orphan containers ([roottestrestoreexternalengines-gw7-zoo2-1 roottestrestoreexternalengines-gw7-zoo1-1 roottestrestoreexternalengines-gw7-zoo3-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up." Stderr: Container roottestrestoreexternalengines-gw7-mysql80-1 Creating Stderr: Container roottestrestoreexternalengines-gw7-mysql80-1 Creating Stderr: Container roottestrestoreexternalengines-gw7-mysql80-1 Created Stderr: Container roottestrestoreexternalengines-gw7-mysql80-1 Created Stderr: Container roottestrestoreexternalengines-gw7-mysql80-1 Starting Stderr: Container roottestrestoreexternalengines-gw7-mysql80-1 Starting Stderr: Container roottestrestoreexternalengines-gw7-mysql80-1 Started Stderr: Container roottestrestoreexternalengines-gw7-mysql80-1 Started Stderr:time="2025-04-02T02:55:11Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:11Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:11Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:11Z" level=debug msg="otel error" error="" get_instance_ip instance_name=mysql80 get_instance_ip instance_name=mysql80 http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw7-mysql80-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw7-mysql80-1/json HTTP/1.1" 200 None Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Executing query SELECT * FROM `test_database_1`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database_1`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance [gw5] PASSED test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); DROP TABLE test; on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); DROP TABLE test; on node Executing query select 20 on node2 Executing query select 20 on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query SHOW TABLES FROM `test_database_1` WHERE name = 'postgresql_replica_3' on instance Executing query SHOW TABLES FROM `test_database_1` WHERE name = 'postgresql_replica_3' on instance [gw5] PASSED test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); DROP TABLE test; on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); DROP TABLE test; on node Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Executing query select * from `postgres_database_1`.`postgresql_replica_3` order by key; on instance Executing query select * from `postgres_database_1`.`postgresql_replica_3` order by key; on instance [gw5] PASSED test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); DROP TABLE test; on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); DROP TABLE test; on node Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Executing query select * from `test_database_1`.`postgresql_replica_3` order by key; on instance Executing query select * from `test_database_1`.`postgresql_replica_3` order by key; on instance run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] [gw5] PASSED test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); DROP TABLE test; on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB PRIMARY KEY(key); DROP TABLE test; on node Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Stdout:790 Stdout:790 ERROR Client failed! Return code: 210, stderr: Code: 210. DB::NetException: Connection refused (172.16.5.5:9000). (NETWORK_ERROR) ERROR Client failed! Return code: 210, stderr: Code: 210. DB::NetException: Connection refused (172.16.5.5:9000). (NETWORK_ERROR) run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicateduserdefinedfunctions-gw2-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicateduserdefinedfunctions-gw2-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Stdout:790 Stdout:790 Executing query select 20 on node2 Executing query select 20 on node2 http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Executing query SELECT * FROM `test_database_1`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database_1`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB(0) PRIMARY KEY(key); DROP TABLE test; on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB(0) PRIMARY KEY(key); DROP TABLE test; on node Executing query select name, create_query from system.resources order by all on node Executing query select name, create_query from system.resources order by all on node Executing query SHOW TABLES FROM `test_database_1` WHERE name = 'postgresql_replica_4' on instance Executing query SHOW TABLES FROM `test_database_1` WHERE name = 'postgresql_replica_4' on instance Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB(10) PRIMARY KEY(key); DROP TABLE test; on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB(10) PRIMARY KEY(key); DROP TABLE test; on node Executing query select name, create_query from system.resources order by all on node2 Executing query select name, create_query from system.resources order by all on node2 Executing query select * from `postgres_database_1`.`postgresql_replica_4` order by key; on instance Executing query select * from `postgres_database_1`.`postgresql_replica_4` order by key; on instance Executing query select 20 on node2 Executing query select 20 on node2 Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB(0, '/var/lib/clickhouse/store/test_rocksdb_read_only') PRIMARY KEY(key); DROP TABLE test; on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB(0, '/var/lib/clickhouse/store/test_rocksdb_read_only') PRIMARY KEY(key); DROP TABLE test; on node Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node Executing query select * from `test_database_1`.`postgresql_replica_4` order by key; on instance Executing query select * from `test_database_1`.`postgresql_replica_4` order by key; on instance Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB(10, '/var/lib/clickhouse/store/test_rocksdb_read_only', 1) PRIMARY KEY(key); DROP TABLE test; on node Executing query CREATE TABLE test (key UInt64, value String) Engine=EmbeddedRocksDB(10, '/var/lib/clickhouse/store/test_rocksdb_read_only', 1) PRIMARY KEY(key); DROP TABLE test; on node http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 Executing query SELECT * FROM `test_database_2`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database_2`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Command:[docker compose --env-file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/.env --project-name roottestrocksdboptions-gw5 --file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/node/docker-compose.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/.env --project-name roottestrocksdboptions-gw5 --file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/node/docker-compose.yml stop --timeout 20] [gw5] PASSED test_rocksdb_options/test.py::test_valid_options Executing query select 20 on node2 Executing query select 20 on node2 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/51bc45e8309a2948fb815117b823e127c457cf249b67e97e35f3522e5190b8d0/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/51bc45e8309a2948fb815117b823e127c457cf249b67e97e35f3522e5190b8d0/start HTTP/1.1" 101 0 Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") http://localhost:None "GET /v1.46/exec/51bc45e8309a2948fb815117b823e127c457cf249b67e97e35f3522e5190b8d0/json HTTP/1.1" 200 461 http://localhost:None "GET /v1.46/exec/51bc45e8309a2948fb815117b823e127c457cf249b67e97e35f3522e5190b8d0/json HTTP/1.1" 200 461 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/6e56301ca79786bf5df8d0b2fb8bff98eb7b180e1f415308057d1840a4ad7b70/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/6e56301ca79786bf5df8d0b2fb8bff98eb7b180e1f415308057d1840a4ad7b70/start HTTP/1.1" 101 0 Executing query SHOW TABLES FROM `test_database_2` WHERE name = 'postgresql_replica_0' on instance Executing query SHOW TABLES FROM `test_database_2` WHERE name = 'postgresql_replica_0' on instance http://localhost:None "GET /v1.46/exec/6e56301ca79786bf5df8d0b2fb8bff98eb7b180e1f415308057d1840a4ad7b70/json HTTP/1.1" 200 461 http://localhost:None "GET /v1.46/exec/6e56301ca79786bf5df8d0b2fb8bff98eb7b180e1f415308057d1840a4ad7b70/json HTTP/1.1" 200 461 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): Executing query create workload all; on node Executing query create workload all; on node Executing query SELECT create_query FROM system.functions WHERE name='f1' on node2 Executing query SELECT create_query FROM system.functions WHERE name='f1' on node2 Stderr: Container roottestrocksdboptions-gw5-node-1 Stopping Stderr: Container roottestrocksdboptions-gw5-node-1 Stopping Stderr: Container roottestrocksdboptions-gw5-node-1 Stopped Stderr: Container roottestrocksdboptions-gw5-node-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/.env --project-name roottestrocksdboptions-gw5 --file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/node/docker-compose.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/.env --project-name roottestrocksdboptions-gw5 --file /ClickHouse/tests/integration/test_rocksdb_options/_instances-0-gw5/node/docker-compose.yml down --volumes] Executing query create workload X in all settings priority = 0; on node Executing query create workload X in all settings priority = 0; on node Executing query select * from `postgres_database_2`.`postgresql_replica_0` order by key; on instance Executing query select * from `postgres_database_2`.`postgresql_replica_0` order by key; on instance Starting zookeeper node: zoo1 Starting zookeeper node: zoo1 Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo1] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo1] Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Executing query create workload Y in all settings priority = 1; on node Executing query create workload Y in all settings priority = 1; on node http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Executing query select * from `test_database_2`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database_2`.`postgresql_replica_0` order by key; on instance Executing query create workload A1 in X settings priority = -1; on node Executing query create workload A1 in X settings priority = -1; on node Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Started Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Started Starting zookeeper node: zoo2 Starting zookeeper node: zoo2 Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo2] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo2] Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: zoo2 Skipped - Image is already being pulled by node1 Stderr: zoo2 Skipped - Image is already being pulled by node1 Stderr: zoo3 Skipped - Image is already being pulled by node1 Stderr: zoo3 Skipped - Image is already being pulled by node1 Stderr: zoo1 Skipped - Image is already being pulled by node1 Stderr: zoo1 Skipped - Image is already being pulled by node1 Stderr: resolver Pulling Stderr: resolver Pulling Stderr: minio1 Pulling Stderr: minio1 Pulling Stderr: proxy1 Pulling Stderr: proxy1 Pulling Stderr: node1 Pulling Stderr: node1 Pulling Stderr: minio1 Pulled Stderr: minio1 Pulled Stderr: proxy1 Pulled Stderr: proxy1 Pulled Stderr: node1 Pulled Stderr: node1 Pulled Stderr: resolver Pulled Stderr: resolver Pulled Setup ZooKeeper Setup ZooKeeper Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper1/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper1/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper1/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper2/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper2/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper2/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper3/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper3/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper3/coordination'] Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper1/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper1/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper1/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper2/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper2/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper2/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper3/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper3/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/keeper3/coordination'] Command:[docker compose --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Command:[docker compose --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Stderr: Container roottestrocksdboptions-gw5-node-1 Stopping Stderr: Container roottestrocksdboptions-gw5-node-1 Stopping Stderr: Container roottestrocksdboptions-gw5-node-1 Stopped Stderr: Container roottestrocksdboptions-gw5-node-1 Stopped Stderr: Container roottestrocksdboptions-gw5-node-1 Removing Stderr: Container roottestrocksdboptions-gw5-node-1 Removing Stderr: Container roottestrocksdboptions-gw5-node-1 Removed Stderr: Container roottestrocksdboptions-gw5-node-1 Removed Stderr: Network roottestrocksdboptions-gw5_default Removing Stderr: Network roottestrocksdboptions-gw5_default Removing Stderr: Network roottestrocksdboptions-gw5_default Removed Stderr: Network roottestrocksdboptions-gw5_default Removed Cleanup called Cleanup called Docker networks for project roottestrocksdboptions-gw5 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestrocksdboptions-gw5 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestrocksdboptions-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestrocksdboptions-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Executing query SELECT * FROM `test_database_2`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database_2`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Docker volumes for project roottestrocksdboptions-gw5 are DRIVER VOLUME NAME Docker volumes for project roottestrocksdboptions-gw5 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestrocksdboptions-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestrocksdboptions-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestrocksdboptions-gw5 No running containers for project: roottestrocksdboptions-gw5 Trying to prune unused networks... Trying to prune unused networks... Stderr: zoo1 Skipped - Image is already being pulled by zoo3 Stderr: zoo1 Skipped - Image is already being pulled by zoo3 Stderr: zoo2 Skipped - Image is already being pulled by zoo3 Stderr: zoo2 Skipped - Image is already being pulled by zoo3 Stderr: node Skipped - Image is already being pulled by zoo3 Stderr: node Skipped - Image is already being pulled by zoo3 Stderr: zoo3 Pulling Stderr: zoo3 Pulling Stderr: zoo3 Pulled Stderr: zoo3 Pulled Setup ZooKeeper Setup ZooKeeper Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper1/log', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper1/config', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper1/coordination', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper2/log', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper2/config', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper2/coordination', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper3/log', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper3/config', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper3/coordination'] Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper1/log', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper1/config', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper1/coordination', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper2/log', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper2/config', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper2/coordination', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper3/log', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper3/config', '/ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/keeper3/coordination'] Command:[docker compose --project-name roottestreloadauxiliaryzookeepers-gw6 --env-file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Command:[docker compose --project-name roottestreloadauxiliaryzookeepers-gw6 --env-file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Executing query create workload B1 in X settings priority = 1; on node Executing query create workload B1 in X settings priority = 1; on node Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:10 Stdout:10 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 10 Volumes pruned: 10 test_s3_latency_log/test.py::test_latency_log ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV HOSTNAME 3624a24af23d ENV HOSTNAME 3624a24af23d ENV SHLVL 0 ENV SHLVL 0 ENV HOME /root ENV HOME /root ENV OLDPWD / ENV OLDPWD / ENV DOCKER_HELPER_TAG 5dc43a6382f0 ENV DOCKER_HELPER_TAG 5dc43a6382f0 ENV PYTHONUNBUFFERED 1 ENV PYTHONUNBUFFERED 1 ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e ENV UBSAN_OPTIONS print_stacktrace=1 ENV UBSAN_OPTIONS print_stacktrace=1 ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots test_postgresql_replica_database_engine_1/test.py::test_virtual_columns test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_remote_prewhere/test.py::test_remote test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16]' 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12]' test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replicated_user_defined_functions/test.py::test_create_and_drop 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1]' 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0]' test_replicated_user_defined_functions/test.py::test_create_and_replace test_replicated_user_defined_functions/test.py::test_drop_if_exists test_replicated_user_defined_functions/test.py::test_reload_zookeeper test_replicated_user_defined_functions/test.py::test_replication test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation test_replicated_user_defined_functions/test.py::test_server_restart test_replicated_user_defined_functions/test.py::test_start_without_zookeeper test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_s3_imds/test_session_token.py::test_credentials_from_metadata test_s3_imds/test_simple.py::test_credentials_from_metadata test_s3_latency_log/test.py::test_latency_log test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver]' test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy test_scheduler/test.py::test_create_workload test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_resource_any_disk test_scheduler/test.py::test_resource_read_and_write test_scheduler/test.py::test_s3_disk test_scheduler/test.py::test_s3_resource_request_granularity test_scheduler/test.py::test_throw_on_unknown_workload test_scheduler/test.py::test_workload_entity_keeper_storage test_scheduler/test.py::test_workload_hierarchy_changes test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings -vvv -ss ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots test_postgresql_replica_database_engine_1/test.py::test_virtual_columns test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_remote_prewhere/test.py::test_remote test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16]' 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12]' test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replicated_user_defined_functions/test.py::test_create_and_drop 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1]' 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0]' test_replicated_user_defined_functions/test.py::test_create_and_replace test_replicated_user_defined_functions/test.py::test_drop_if_exists test_replicated_user_defined_functions/test.py::test_reload_zookeeper test_replicated_user_defined_functions/test.py::test_replication test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation test_replicated_user_defined_functions/test.py::test_server_restart test_replicated_user_defined_functions/test.py::test_start_without_zookeeper test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_s3_imds/test_session_token.py::test_credentials_from_metadata test_s3_imds/test_simple.py::test_credentials_from_metadata test_s3_latency_log/test.py::test_latency_log test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver]' test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy test_scheduler/test.py::test_create_workload test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_resource_any_disk test_scheduler/test.py::test_resource_read_and_write test_scheduler/test.py::test_s3_disk test_scheduler/test.py::test_s3_resource_request_granularity test_scheduler/test.py::test_throw_on_unknown_workload test_scheduler/test.py::test_workload_entity_keeper_storage test_scheduler/test.py::test_workload_hierarchy_changes test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings -vvv -ss ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge ENV COMPOSE_HTTP_TIMEOUT 600 ENV COMPOSE_HTTP_TIMEOUT 600 ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_CHANNEL stable ENV DOCKER_CHANNEL stable ENV DOCKER_CLIENT_TIMEOUT 300 ENV DOCKER_CLIENT_TIMEOUT 300 ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV PWD /ClickHouse/tests/integration ENV PWD /ClickHouse/tests/integration ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV TZ Etc/UTC ENV TZ Etc/UTC ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV DOCKER_BASE_TAG 8b2301119731 ENV DOCKER_BASE_TAG 8b2301119731 ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV LC_CTYPE C.UTF-8 ENV LC_CTYPE C.UTF-8 ENV INTEGRATION_TESTS_RUN_ID 0 ENV INTEGRATION_TESTS_RUN_ID 0 ENV WORKER_FREE_PORTS 30250 30251 30252 30253 30254 30255 30256 30257 30258 30259 30260 30261 30262 30263 30264 30265 30266 30267 30268 30269 30270 30271 30272 30273 30274 30275 30276 30277 30278 30279 30280 30281 30282 30283 30284 30285 30286 30287 30288 30289 30290 30291 30292 30293 30294 30295 30296 30297 30298 30299 ENV WORKER_FREE_PORTS 30250 30251 30252 30253 30254 30255 30256 30257 30258 30259 30260 30261 30262 30263 30264 30265 30266 30267 30268 30269 30270 30271 30272 30273 30274 30275 30276 30277 30278 30279 30280 30281 30282 30283 30284 30285 30286 30287 30288 30289 30290 30291 30292 30293 30294 30295 30296 30297 30298 30299 ENV PYTEST_XDIST_TESTRUNUID c5ba503209524253afe87e95762d6d1b ENV PYTEST_XDIST_TESTRUNUID c5ba503209524253afe87e95762d6d1b ENV PYTEST_XDIST_WORKER gw5 ENV PYTEST_XDIST_WORKER gw5 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV PYTEST_CURRENT_TEST test_s3_latency_log/test.py::test_latency_log (setup) ENV PYTEST_CURRENT_TEST test_s3_latency_log/test.py::test_latency_log (setup) CLUSTER INIT base_config_dir:/clickhouse-config CLUSTER INIT base_config_dir:/clickhouse-config clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Cluster name: project_name:roottests3latencylog-gw5. Added instance name:node tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/.env', '--project-name', 'roottests3latencylog-gw5', '--file', '/ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottests3latencylog-gw5. Added instance name:node tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/.env', '--project-name', 'roottests3latencylog-gw5', '--file', '/ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Starting cluster... Starting cluster... Running tests in /ClickHouse/tests/integration/test_s3_latency_log/test.py Running tests in /ClickHouse/tests/integration/test_s3_latency_log/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottests3latencylog-gw5 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3latencylog-gw5 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3latencylog-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3latencylog-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3latencylog-gw5 are DRIVER VOLUME NAME Docker volumes for project roottests3latencylog-gw5 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottests3latencylog-gw5 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3latencylog-gw5 are NETWORK ID NAME DRIVER SCOPE Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Started Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Started Starting zookeeper node: zoo3 Starting zookeeper node: zoo3 Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo3] Command:[docker compose --project-name roottestreplicateduserdefinedfunctions-gw2 --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo3] Docker containers for project roottests3latencylog-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3latencylog-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3latencylog-gw5 are DRIVER VOLUME NAME Docker volumes for project roottests3latencylog-gw5 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3latencylog-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3latencylog-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3latencylog-gw5 No running containers for project: roottests3latencylog-gw5 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Executing query SHOW TABLES FROM `test_database_2` WHERE name = 'postgresql_replica_1' on instance Executing query SHOW TABLES FROM `test_database_2` WHERE name = 'postgresql_replica_1' on instance Stdout:10 Stdout:10 Command:[docker volume prune -f] Command:[docker volume prune -f] Executing query create workload C1 in Y settings priority = -1; on node Executing query create workload C1 in Y settings priority = -1; on node Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 10 Volumes pruned: 10 Setup directory for instance: node Setup directory for instance: node Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_s3_latency_log/configs/storage_conf.xml'] to /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/node/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_s3_latency_log/configs/storage_conf.xml'] to /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/node/configs/config.d Setup database dir /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/node/database Setup database dir /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/node/database Setup logs dir /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/node/logs Setup logs dir /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/node/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/.env --project-name roottests3latencylog-gw5 --file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/.env --project-name roottests3latencylog-gw5 --file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Executing query select * from `postgres_database_2`.`postgresql_replica_1` order by key; on instance Executing query select * from `postgres_database_2`.`postgresql_replica_1` order by key; on instance http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Starting Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Started Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Started get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.5.2, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.5.2, port:2181, use_ssl:False http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Executing query create workload D1 in Y settings priority = 1; on node Executing query create workload D1 in Y settings priority = 1; on node Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Stderr:time="2025-04-02T02:55:15Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:55:15Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestreplicatedmergetreereplicateddbttl-gw3_default Creating Stderr: Network roottestreplicatedmergetreereplicateddbttl-gw3_default Creating Stderr: Network roottestreplicatedmergetreereplicateddbttl-gw3_default Created Stderr: Network roottestreplicatedmergetreereplicateddbttl-gw3_default Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Started Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Started Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Started Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Started Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Started Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Started Stderr:time="2025-04-02T02:55:16Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:16Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:16Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:16Z" level=debug msg="otel error" error="" Wait ZooKeeper to start Wait ZooKeeper to start get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.2.2, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.2.2, port:2181, use_ssl:False Connecting to 172.16.2.2(172.16.2.2):2181, use_ssl: False Connecting to 172.16.2.2(172.16.2.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Executing query create workload A2 in X settings priority = -1; on node Executing query create workload A2 in X settings priority = -1; on node Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.2.2(172.16.2.2):2181, use_ssl: False Connecting to 172.16.2.2(172.16.2.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query select * from `test_database_2`.`postgresql_replica_1` order by key; on instance Executing query select * from `test_database_2`.`postgresql_replica_1` order by key; on instance Stderr:time="2025-04-02T02:55:15Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:55:15Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestreloadauxiliaryzookeepers-gw6_default Creating Stderr: Network roottestreloadauxiliaryzookeepers-gw6_default Creating Stderr: Network roottestreloadauxiliaryzookeepers-gw6_default Created Stderr: Network roottestreloadauxiliaryzookeepers-gw6_default Created Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo2-1 Creating Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo2-1 Creating Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo3-1 Creating Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo3-1 Creating Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo1-1 Creating Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo1-1 Creating Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo3-1 Created Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo3-1 Created Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo2-1 Created Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo2-1 Created Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo1-1 Created Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo1-1 Created Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo2-1 Starting Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo2-1 Starting Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo3-1 Starting Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo3-1 Starting Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo1-1 Starting Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo1-1 Starting Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo2-1 Started Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo2-1 Started Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo3-1 Started Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo3-1 Started Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo1-1 Started Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo1-1 Started Stderr:time="2025-04-02T02:55:16Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:16Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:16Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:16Z" level=debug msg="otel error" error="" Wait ZooKeeper to start Wait ZooKeeper to start get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreloadauxiliaryzookeepers-gw6-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadauxiliaryzookeepers-gw6-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.7.3, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.7.3, port:2181, use_ssl:False Connecting to 172.16.7.3(172.16.7.3):2181, use_ssl: False Connecting to 172.16.7.3(172.16.7.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query create workload B2 in X settings priority = 1; on node Executing query create workload B2 in X settings priority = 1; on node Connecting to 172.16.7.3(172.16.7.3):2181, use_ssl: False Connecting to 172.16.7.3(172.16.7.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.2.2(172.16.2.2):2181, use_ssl: False Connecting to 172.16.2.2(172.16.2.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query SELECT * FROM `test_database_2`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database_2`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Connecting to 172.16.7.3(172.16.7.3):2181, use_ssl: False Connecting to 172.16.7.3(172.16.7.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query create workload C2 in Y settings priority = -1; on node Executing query create workload C2 in Y settings priority = -1; on node Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Connecting to 172.16.7.3(172.16.7.3):2181, use_ssl: False Connecting to 172.16.7.3(172.16.7.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query SHOW TABLES FROM `test_database_2` WHERE name = 'postgresql_replica_2' on instance Executing query SHOW TABLES FROM `test_database_2` WHERE name = 'postgresql_replica_2' on instance Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Executing query create workload D2 in Y settings priority = 1; on node Executing query create workload D2 in Y settings priority = 1; on node Connecting to 172.16.2.2(172.16.2.2):2181, use_ssl: False Connecting to 172.16.2.2(172.16.2.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.7.3(172.16.7.3):2181, use_ssl: False Connecting to 172.16.7.3(172.16.7.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query drop workload A1; on node Executing query drop workload A1; on node Executing query select * from `postgres_database_2`.`postgresql_replica_2` order by key; on instance Executing query select * from `postgres_database_2`.`postgresql_replica_2` order by key; on instance Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Executing query drop workload A2; on node Executing query drop workload A2; on node Executing query select * from `test_database_2`.`postgresql_replica_2` order by key; on instance Executing query select * from `test_database_2`.`postgresql_replica_2` order by key; on instance Executing query drop workload B1; on node Executing query drop workload B1; on node Executing query SELECT * FROM `test_database_2`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database_2`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query drop workload B2; on node Executing query drop workload B2; on node http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Executing query SHOW TABLES FROM `test_database_2` WHERE name = 'postgresql_replica_3' on instance Executing query SHOW TABLES FROM `test_database_2` WHERE name = 'postgresql_replica_3' on instance Connecting to 172.16.2.2(172.16.2.2):2181, use_ssl: False Connecting to 172.16.2.2(172.16.2.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query drop workload C1; on node Executing query drop workload C1; on node Connecting to 172.16.7.3(172.16.7.3):2181, use_ssl: False Connecting to 172.16.7.3(172.16.7.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query select * from `postgres_database_2`.`postgresql_replica_3` order by key; on instance Executing query select * from `postgres_database_2`.`postgresql_replica_3` order by key; on instance Executing query drop workload C2; on node Executing query drop workload C2; on node Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Executing query drop workload D1; on node Executing query drop workload D1; on node Executing query select * from `test_database_2`.`postgresql_replica_3` order by key; on instance Executing query select * from `test_database_2`.`postgresql_replica_3` order by key; on instance Executing query drop workload D2; on node Executing query drop workload D2; on node Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Executing query SELECT * FROM `test_database_2`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database_2`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query create workload Z in all; on node Executing query create workload Z in all; on node http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Executing query SHOW TABLES FROM `test_database_2` WHERE name = 'postgresql_replica_4' on instance Executing query SHOW TABLES FROM `test_database_2` WHERE name = 'postgresql_replica_4' on instance Executing query create workload A1 in Z settings priority = -1; on node Executing query create workload A1 in Z settings priority = -1; on node Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Executing query select * from `postgres_database_2`.`postgresql_replica_4` order by key; on instance Executing query select * from `postgres_database_2`.`postgresql_replica_4` order by key; on instance Executing query create workload A2 in Z settings priority = -1; on node Executing query create workload A2 in Z settings priority = -1; on node Executing query create workload A3 in Z settings priority = -1; on node Executing query create workload A3 in Z settings priority = -1; on node Executing query select * from `test_database_2`.`postgresql_replica_4` order by key; on instance Executing query select * from `test_database_2`.`postgresql_replica_4` order by key; on instance Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Executing query create workload B1 in Z settings priority = 1; on node Executing query create workload B1 in Z settings priority = 1; on node Executing query DROP DATABASE IF EXISTS `test_database_1` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database_1` SYNC on instance [gw0] PASSED test_postgresql_replica_database_engine_1/test.py::test_multiple_databases Executing query create workload B2 in Z settings priority = 1; on node Executing query create workload B2 in Z settings priority = 1; on node http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Executing query DROP DATABASE IF EXISTS `test_database_2` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database_2` SYNC on instance Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['clickhouse', 'keeper'] Received response(xid=1): ['clickhouse', 'keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Executing query create workload B3 in Z settings priority = 1; on node Executing query create workload B3 in Z settings priority = 1; on node Connecting to 172.16.2.2(172.16.2.2):2181, use_ssl: False Connecting to 172.16.2.2(172.16.2.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.5.3, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.5.3, port:2181, use_ssl:False Connecting to 172.16.5.3(172.16.5.3):2181, use_ssl: False Connecting to 172.16.5.3(172.16.5.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Can't connect to MySQL 8 (2003, "Can't connect to MySQL server on '172.16.3.5' ([Errno 111] Connection refused)") Received response(xid=1): ['clickhouse', 'keeper'] Received response(xid=1): ['clickhouse', 'keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicateduserdefinedfunctions-gw2-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.5.4, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.5.4, port:2181, use_ssl:False Connecting to 172.16.5.4(172.16.5.4):2181, use_ssl: False Connecting to 172.16.5.4(172.16.5.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['clickhouse', 'keeper'] Received response(xid=1): ['clickhouse', 'keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Connecting to 172.16.7.3(172.16.7.3):2181, use_ssl: False Connecting to 172.16.7.3(172.16.7.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query DROP DATABASE IF EXISTS "postgres_database_1" on instance Executing query DROP DATABASE IF EXISTS "postgres_database_1" on instance Executing query create workload C1 in X settings priority = -1; on node Executing query create workload C1 in X settings priority = -1; on node Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ['zoo1', 'zoo2', 'zoo3'] All instances of ZooKeeper started: ['zoo1', 'zoo2', 'zoo3'] Executing query SELECT create_query FROM system.functions WHERE name='f1' on node2 Executing query SELECT create_query FROM system.functions WHERE name='f1' on node2 Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query create workload C2 in X settings priority = -1; on node Executing query create workload C2 in X settings priority = -1; on node Mysql 8 Started Mysql 8 Started ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/.env --project-name roottestrestoreexternalengines-gw7 --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_mysql_8_0.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica2/docker-compose.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica3/docker-compose.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/.env --project-name roottestrestoreexternalengines-gw7 --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_mysql_8_0.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica2/docker-compose.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica3/docker-compose.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/.env --project-name roottestrestoreexternalengines-gw7 --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_mysql_8_0.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica2/docker-compose.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica3/docker-compose.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/.env --project-name roottestrestoreexternalengines-gw7 --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_mysql_8_0.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica2/docker-compose.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica3/docker-compose.yml up -d --no-recreate] Executing query DROP DATABASE IF EXISTS "postgres_database_2" on instance Executing query DROP DATABASE IF EXISTS "postgres_database_2" on instance Executing query create workload C3 in X settings priority = -1; on node Executing query create workload C3 in X settings priority = -1; on node http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Executing query create workload D1 in X settings priority = 1; on node Executing query create workload D1 in X settings priority = 1; on node http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Executing query SELECT create_query FROM system.functions WHERE name='f1' on node2 Executing query SELECT create_query FROM system.functions WHERE name='f1' on node2 Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Stderr: Container roottestrestoreexternalengines-gw7-mysql80-1 Running Stderr: Container roottestrestoreexternalengines-gw7-mysql80-1 Running Stderr: Container roottestrestoreexternalengines-gw7-zoo1-1 Running Stderr: Container roottestrestoreexternalengines-gw7-zoo1-1 Running Stderr: Container roottestrestoreexternalengines-gw7-zoo2-1 Running Stderr: Container roottestrestoreexternalengines-gw7-zoo2-1 Running Stderr: Container roottestrestoreexternalengines-gw7-zoo3-1 Running Stderr: Container roottestrestoreexternalengines-gw7-zoo3-1 Running Stderr: Container roottestrestoreexternalengines-gw7-replica2-1 Creating Stderr: Container roottestrestoreexternalengines-gw7-replica2-1 Creating Stderr: Container roottestrestoreexternalengines-gw7-replica1-1 Creating Stderr: Container roottestrestoreexternalengines-gw7-replica1-1 Creating Stderr: Container roottestrestoreexternalengines-gw7-replica3-1 Creating Stderr: Container roottestrestoreexternalengines-gw7-replica3-1 Creating Stderr: Container roottestrestoreexternalengines-gw7-replica1-1 Created Stderr: Container roottestrestoreexternalengines-gw7-replica1-1 Created Stderr: Container roottestrestoreexternalengines-gw7-replica2-1 Created Stderr: Container roottestrestoreexternalengines-gw7-replica2-1 Created Stderr: Container roottestrestoreexternalengines-gw7-replica3-1 Created Stderr: Container roottestrestoreexternalengines-gw7-replica3-1 Created Stderr: Container roottestrestoreexternalengines-gw7-replica1-1 Starting Stderr: Container roottestrestoreexternalengines-gw7-replica1-1 Starting Stderr: Container roottestrestoreexternalengines-gw7-replica2-1 Starting Stderr: Container roottestrestoreexternalengines-gw7-replica2-1 Starting Stderr: Container roottestrestoreexternalengines-gw7-replica3-1 Starting Stderr: Container roottestrestoreexternalengines-gw7-replica3-1 Starting Stderr: Container roottestrestoreexternalengines-gw7-replica3-1 Started Stderr: Container roottestrestoreexternalengines-gw7-replica3-1 Started Stderr: Container roottestrestoreexternalengines-gw7-replica1-1 Started Stderr: Container roottestrestoreexternalengines-gw7-replica1-1 Started Stderr: Container roottestrestoreexternalengines-gw7-replica2-1 Started Stderr: Container roottestrestoreexternalengines-gw7-replica2-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=replica1 get_instance_ip instance_name=replica1 http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw7-replica1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw7-replica1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=replica1 get_instance_ip instance_name=replica1 http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw7-replica1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw7-replica1-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in replica1, ip: 172.16.3.8... Waiting for ClickHouse start in replica1, ip: 172.16.3.8... http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw7-replica1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw7-replica1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None Executing query create workload D2 in X settings priority = 1; on node Executing query create workload D2 in X settings priority = 1; on node http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query DROP FUNCTION f1 on node1 Executing query DROP FUNCTION f1 on node1 http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None Executing query create workload D3 in X settings priority = 1; on node Executing query create workload D3 in X settings priority = 1; on node http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None test_postgresql_replica_database_engine_1/test.py::test_quoting_1 Executing query INSERT INTO `postgres_database`.`user` SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.`user` SELECT number, number from numbers(50) on instance http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --project-name roottestreplicateduserdefinedfunctions-gw2 --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/docker-compose.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --project-name roottestreplicateduserdefinedfunctions-gw2 --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/docker-compose.yml stop --timeout 20] [gw2] PASSED test_replicated_user_defined_functions/test.py::test_start_without_zookeeper Executing query drop workload A1; on node Executing query drop workload A1; on node http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None [gw4] PASSED test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3] test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver] Executing query CREATE TABLE s3_test ( id Int64, data String ) ENGINE=MergeTree() ORDER BY id SETTINGS storage_policy='s3_with_resolver' on node Executing query CREATE TABLE s3_test ( id Int64, data String ) ENGINE=MergeTree() ORDER BY id SETTINGS storage_policy='s3_with_resolver' on node Executing query drop workload B1; on node Executing query drop workload B1; on node http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query drop workload C1; on node Executing query drop workload C1; on node Executing query INSERT INTO s3_test VALUES (0,'data'),(1,'data') on node Executing query INSERT INTO s3_test VALUES (0,'data'),(1,'data') on node http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance Executing query drop workload D1; on node Executing query drop workload D1; on node http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None Executing query SELECT * FROM s3_test order by id FORMAT Values on node Executing query SELECT * FROM s3_test order by id FORMAT Values on node http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None Executing query drop workload A2; on node Executing query drop workload A2; on node http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None Executing query SELECT * FROM `test_database`.`user` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`user` LIMIT 1 FORMAT Null on instance http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None Executing query DROP TABLE IF EXISTS s3_test SYNC on node Executing query DROP TABLE IF EXISTS s3_test SYNC on node http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/fcc9d0ceb1e55e5b6d4982c404a79a6d7d666502cd32ed2b3cda019df4b33ad5/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/fcc9d0ceb1e55e5b6d4982c404a79a6d7d666502cd32ed2b3cda019df4b33ad5/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None Executing query SHOW TABLES FROM `test_database` WHERE name = 'user' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'user' on instance http://localhost:None "GET /v1.46/exec/fcc9d0ceb1e55e5b6d4982c404a79a6d7d666502cd32ed2b3cda019df4b33ad5/json HTTP/1.1" 200 457 http://localhost:None "GET /v1.46/exec/fcc9d0ceb1e55e5b6d4982c404a79a6d7d666502cd32ed2b3cda019df4b33ad5/json HTTP/1.1" 200 457 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/b53099b59fb5da91592aea25568dc12ae8c3483d0ec5e71c4a8ed67c61044fec/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/b53099b59fb5da91592aea25568dc12ae8c3483d0ec5e71c4a8ed67c61044fec/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/exec/b53099b59fb5da91592aea25568dc12ae8c3483d0ec5e71c4a8ed67c61044fec/json HTTP/1.1" 200 457 http://localhost:None "GET /v1.46/exec/b53099b59fb5da91592aea25568dc12ae8c3483d0ec5e71c4a8ed67c61044fec/json HTTP/1.1" 200 457 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None Executing query select * from `postgres_database`.`user` order by key; on instance Executing query select * from `postgres_database`.`user` order by key; on instance http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/49ca2ab341cc4ae00ea9b8a262540cfc01fc4f63f311e848e3cd56aa1871d5bc/json HTTP/1.1" 200 None ClickHouse replica1 started ClickHouse replica1 started get_instance_ip instance_name=replica2 get_instance_ip instance_name=replica2 http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw7-replica2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw7-replica2-1/json HTTP/1.1" 200 None get_instance_ip instance_name=replica2 get_instance_ip instance_name=replica2 http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw7-replica2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw7-replica2-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in replica2, ip: 172.16.3.6... Waiting for ClickHouse start in replica2, ip: 172.16.3.6... http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw7-replica2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw7-replica2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/0fb4e6acc203d347357ee1c0fe7d2e9aa1e8ee8fbecae58860d1a91f56afef94/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/0fb4e6acc203d347357ee1c0fe7d2e9aa1e8ee8fbecae58860d1a91f56afef94/json HTTP/1.1" 200 None ClickHouse replica2 started ClickHouse replica2 started get_instance_ip instance_name=replica3 get_instance_ip instance_name=replica3 http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw7-replica3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw7-replica3-1/json HTTP/1.1" 200 None get_instance_ip instance_name=replica3 get_instance_ip instance_name=replica3 http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw7-replica3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw7-replica3-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in replica3, ip: 172.16.3.7... Waiting for ClickHouse start in replica3, ip: 172.16.3.7... http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw7-replica3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestoreexternalengines-gw7-replica3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/85c81138d9d78815e92657060f0b907824e221f66fe93b16c3eac1c6e50f3946/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/85c81138d9d78815e92657060f0b907824e221f66fe93b16c3eac1c6e50f3946/json HTTP/1.1" 200 None ClickHouse replica3 started ClickHouse replica3 started Executing query DROP DATABASE IF EXISTS replicated SYNC on replica1 Executing query DROP DATABASE IF EXISTS replicated SYNC on replica1 Executing query DROP DATABASE IF EXISTS replicated SYNC on replica2 Executing query DROP DATABASE IF EXISTS replicated SYNC on replica2 Executing query select * from `test_database`.`user` order by key; on instance Executing query select * from `test_database`.`user` order by key; on instance Connecting to 172.16.7.3(172.16.7.3):2181, use_ssl: False Connecting to 172.16.7.3(172.16.7.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestreloadauxiliaryzookeepers-gw6-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadauxiliaryzookeepers-gw6-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.7.2, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.7.2, port:2181, use_ssl:False Connecting to 172.16.7.2(172.16.7.2):2181, use_ssl: False Connecting to 172.16.7.2(172.16.7.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Executing query DROP DATABASE IF EXISTS replicated SYNC on replica3 Executing query DROP DATABASE IF EXISTS replicated SYNC on replica3 Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestreloadauxiliaryzookeepers-gw6-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadauxiliaryzookeepers-gw6-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.7.4, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.7.4, port:2181, use_ssl:False Connecting to 172.16.7.4(172.16.7.4):2181, use_ssl: False Connecting to 172.16.7.4(172.16.7.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/.env --project-name roottestreloadauxiliaryzookeepers-gw6 --file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/.env --project-name roottestreloadauxiliaryzookeepers-gw6 --file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/.env --project-name roottestreloadauxiliaryzookeepers-gw6 --file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/.env --project-name roottestreloadauxiliaryzookeepers-gw6 --file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --project-name roottestreplicateduserdefinedfunctions-gw2 --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/docker-compose.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/.env --project-name roottestreplicateduserdefinedfunctions-gw2 --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_user_defined_functions/_instances-0-gw2/node2/docker-compose.yml down --volumes] http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None Executing query CREATE DATABASE replicated ENGINE = Replicated('/clickhouse/databases/replicated', 'default', 'replica1') on replica1 Executing query CREATE DATABASE replicated ENGINE = Replicated('/clickhouse/databases/replicated', 'default', 'replica1') on replica1 http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance [gw0] PASSED test_postgresql_replica_database_engine_1/test.py::test_quoting_1 Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query CREATE DATABASE replicated ENGINE = Replicated('/clickhouse/databases/replicated', 'default', 'replica2') on replica2 Executing query CREATE DATABASE replicated ENGINE = Replicated('/clickhouse/databases/replicated', 'default', 'replica2') on replica2 Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo3-1 Running Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo3-1 Running Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo2-1 Running Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo2-1 Running Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo1-1 Running Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo1-1 Running Stderr: Container roottestreloadauxiliaryzookeepers-gw6-node-1 Creating Stderr: Container roottestreloadauxiliaryzookeepers-gw6-node-1 Creating Stderr: Container roottestreloadauxiliaryzookeepers-gw6-node-1 Created Stderr: Container roottestreloadauxiliaryzookeepers-gw6-node-1 Created Stderr: Container roottestreloadauxiliaryzookeepers-gw6-node-1 Starting Stderr: Container roottestreloadauxiliaryzookeepers-gw6-node-1 Starting Stderr: Container roottestreloadauxiliaryzookeepers-gw6-node-1 Started Stderr: Container roottestreloadauxiliaryzookeepers-gw6-node-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottestreloadauxiliaryzookeepers-gw6-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadauxiliaryzookeepers-gw6-node-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottestreloadauxiliaryzookeepers-gw6-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadauxiliaryzookeepers-gw6-node-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node, ip: 172.16.7.5... Waiting for ClickHouse start in node, ip: 172.16.7.5... http://localhost:None "GET /v1.46/containers/roottestreloadauxiliaryzookeepers-gw6-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreloadauxiliaryzookeepers-gw6-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None Connecting to 172.16.2.2(172.16.2.2):2181, use_ssl: False Connecting to 172.16.2.2(172.16.2.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Removing Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Removing Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Removing Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Removing Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Removed Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node2-1 Removed Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Removed Stderr: Container roottestreplicateduserdefinedfunctions-gw2-node1-1 Removed Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopping Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Removing Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Removing Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Removing Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Removing Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Stopped Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Removing Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Removing Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Removed Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo3-1 Removed Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Removed Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo2-1 Removed Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Removed Stderr: Container roottestreplicateduserdefinedfunctions-gw2-zoo1-1 Removed Stderr: Network roottestreplicateduserdefinedfunctions-gw2_default Removing Stderr: Network roottestreplicateduserdefinedfunctions-gw2_default Removing Stderr: Network roottestreplicateduserdefinedfunctions-gw2_default Removed Stderr: Network roottestreplicateduserdefinedfunctions-gw2_default Removed Cleanup called Cleanup called Docker networks for project roottestreplicateduserdefinedfunctions-gw2 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicateduserdefinedfunctions-gw2 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicateduserdefinedfunctions-gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicateduserdefinedfunctions-gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicateduserdefinedfunctions-gw2 are DRIVER VOLUME NAME Docker volumes for project roottestreplicateduserdefinedfunctions-gw2 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreplicateduserdefinedfunctions-gw2-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreplicateduserdefinedfunctions-gw2-.*-1$' --format '{{.ID}}:{{.Names}}'] Executing query CREATE DATABASE replicated ENGINE = Replicated('/clickhouse/databases/replicated', 'default', 'replica3') on replica3 Executing query CREATE DATABASE replicated ENGINE = Replicated('/clickhouse/databases/replicated', 'default', 'replica3') on replica3 http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicateduserdefinedfunctions-gw2 No running containers for project: roottestreplicateduserdefinedfunctions-gw2 Trying to prune unused networks... Trying to prune unused networks... Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.2.3, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.2.3, port:2181, use_ssl:False Connecting to 172.16.2.3(172.16.2.3):2181, use_ssl: False Connecting to 172.16.2.3(172.16.2.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:10 Stdout:10 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 10 Volumes pruned: 10 test_settings_constraints_distributed/test.py::test_insert_clamps_settings Running tests in /ClickHouse/tests/integration/test_settings_constraints_distributed/test.py Running tests in /ClickHouse/tests/integration/test_settings_constraints_distributed/test.py Cluster start called. is_up=False Cluster start called. is_up=False Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.2.4, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.2.4, port:2181, use_ssl:False Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Docker networks for project roottestsettingsconstraintsdistributed-gw2 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestsettingsconstraintsdistributed-gw2 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestsettingsconstraintsdistributed-gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestsettingsconstraintsdistributed-gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestsettingsconstraintsdistributed-gw2 are DRIVER VOLUME NAME Docker volumes for project roottestsettingsconstraintsdistributed-gw2 are DRIVER VOLUME NAME Cleanup called Cleanup called Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Docker networks for project roottestsettingsconstraintsdistributed-gw2 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestsettingsconstraintsdistributed-gw2 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestsettingsconstraintsdistributed-gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestsettingsconstraintsdistributed-gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') Trying to create Minio instance by command docker compose --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Trying to create Minio instance by command docker compose --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Command:[docker compose --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Command:[docker compose --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Docker volumes for project roottestsettingsconstraintsdistributed-gw2 are DRIVER VOLUME NAME Docker volumes for project roottestsettingsconstraintsdistributed-gw2 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestsettingsconstraintsdistributed-gw2-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestsettingsconstraintsdistributed-gw2-.*-1$' --format '{{.ID}}:{{.Names}}'] http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestsettingsconstraintsdistributed-gw2 No running containers for project: roottestsettingsconstraintsdistributed-gw2 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:11 Stdout:11 Command:[docker volume prune -f] Command:[docker volume prune -f] Executing query CREATE TABLE replicated.example_s3_engine_table (name String, value UInt32) ENGINE = S3('https://clickhouse-public-datasets.s3.amazonaws.com/my-test-bucket-768/test-data.csv.gz', 'CSV', 'gzip') SETTINGS input_format_with_names_use_header = 0 on replica1 Executing query CREATE TABLE replicated.example_s3_engine_table (name String, value UInt32) ENGINE = S3('https://clickhouse-public-datasets.s3.amazonaws.com/my-test-bucket-768/test-data.csv.gz', 'CSV', 'gzip') SETTINGS input_format_with_names_use_header = 0 on replica1 Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 11 Volumes pruned: 11 Setup directory for instance: node1 Setup directory for instance: node1 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_settings_constraints_distributed/configs/config.d/remote_servers.xml'] to /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_settings_constraints_distributed/configs/config.d/remote_servers.xml'] to /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/configs/config.d Setup database dir /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/database Setup database dir /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/database Setup logs dir /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/logs Setup logs dir /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Setup directory for instance: node2 Setup directory for instance: node2 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_settings_constraints_distributed/configs/config.d/remote_servers.xml'] to /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_settings_constraints_distributed/configs/config.d/remote_servers.xml'] to /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/configs/config.d Setup database dir /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/database Setup database dir /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/database Setup logs dir /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/logs Setup logs dir /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Setup directory for instance: distributed Setup directory for instance: distributed Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_settings_constraints_distributed/configs/config.d/remote_servers.xml'] to /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_settings_constraints_distributed/configs/config.d/remote_servers.xml'] to /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/configs/config.d Setup database dir /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/database Setup database dir /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/database Setup logs dir /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/logs Setup logs dir /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/logs Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw'} stored in /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw'} stored in /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/.env --project-name roottestsettingsconstraintsdistributed-gw2 --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/docker-compose.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/.env --project-name roottestsettingsconstraintsdistributed-gw2 --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/docker-compose.yml pull] http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None test_postgresql_replica_database_engine_1/test.py::test_quoting_2 Executing query INSERT INTO `postgres_database`.`user` SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.`user` SELECT number, number from numbers(50) on instance http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None Executing query CREATE TABLE replicated.mysql_schema_inference_engine ENGINE=MySQL('mysql80:3306', 'clickhouse', 'inference_table', 'root', 'clickhouse') on replica1 Executing query CREATE TABLE replicated.mysql_schema_inference_engine ENGINE=MySQL('mysql80:3306', 'clickhouse', 'inference_table', 'root', 'clickhouse') on replica1 http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None Stderr:time="2025-04-02T02:55:24Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:55:24Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Volume "roottestreplicatedmergetreereplicateddbttl-gw3_data1-1" Creating Stderr: Volume "roottestreplicatedmergetreereplicateddbttl-gw3_data1-1" Creating Stderr: Volume "roottestreplicatedmergetreereplicateddbttl-gw3_data1-1" Created Stderr: Volume "roottestreplicatedmergetreereplicateddbttl-gw3_data1-1" Created Stderr:time="2025-04-02T02:55:24Z" level=warning msg="Found orphan containers ([roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up." Stderr:time="2025-04-02T02:55:24Z" level=warning msg="Found orphan containers ([roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up." Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Started Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Started Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Started Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Started Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Started Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Started Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Started Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Started Stderr:time="2025-04-02T02:55:25Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:25Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:25Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:25Z" level=debug msg="otel error" error="" Trying to connect to Minio... Trying to connect to Minio... get_instance_ip instance_name=minio1 get_instance_ip instance_name=minio1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy1 get_instance_ip instance_name=proxy1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1/json HTTP/1.1" 200 None Starting new HTTP connection (1): 172.16.2.8:9001 Starting new HTTP connection (1): 172.16.2.8:9001 Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (2): 172.16.2.8:9001 Starting new HTTP connection (2): 172.16.2.8:9001 Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (3): 172.16.2.8:9001 Starting new HTTP connection (3): 172.16.2.8:9001 Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (4): 172.16.2.8:9001 Starting new HTTP connection (4): 172.16.2.8:9001 Can't connect to Minio: HTTPConnectionPool(host='172.16.2.8', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Can't connect to Minio: HTTPConnectionPool(host='172.16.2.8', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') SETTINGS materialized_postgresql_tables_list = 'user' on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') SETTINGS materialized_postgresql_tables_list = 'user' on instance http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None Executing query CREATE TABLE replicated.mysql_schema_inference_function AS mysql('mysql80:3306', 'clickhouse', 'inference_table', 'root', 'clickhouse') on replica1 Executing query CREATE TABLE replicated.mysql_schema_inference_function AS mysql('mysql80:3306', 'clickhouse', 'inference_table', 'root', 'clickhouse') on replica1 http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None Stderr: node1 Skipped - Image is already being pulled by distributed Stderr: node1 Skipped - Image is already being pulled by distributed Stderr: node2 Skipped - Image is already being pulled by distributed Stderr: node2 Skipped - Image is already being pulled by distributed Stderr: distributed Pulling Stderr: distributed Pulling Stderr: distributed Pulled Stderr: distributed Pulled ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/.env --project-name roottestsettingsconstraintsdistributed-gw2 --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/docker-compose.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/.env --project-name roottestsettingsconstraintsdistributed-gw2 --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/docker-compose.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/.env --project-name roottestsettingsconstraintsdistributed-gw2 --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/docker-compose.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/.env --project-name roottestsettingsconstraintsdistributed-gw2 --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/docker-compose.yml up -d --no-recreate] Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: node Pulling Stderr: node Pulling Stderr: minio1 Pulling Stderr: minio1 Pulling Stderr: resolver Pulling Stderr: resolver Pulling Stderr: proxy1 Pulling Stderr: proxy1 Pulling Stderr: resolver Pulled Stderr: resolver Pulled Stderr: node Pulled Stderr: node Pulled Stderr: proxy1 Pulled Stderr: proxy1 Pulled Stderr: minio1 Pulled Stderr: minio1 Pulled Trying to create Minio instance by command docker compose --project-name roottests3latencylog-gw5 --env-file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Trying to create Minio instance by command docker compose --project-name roottests3latencylog-gw5 --env-file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Command:[docker compose --project-name roottests3latencylog-gw5 --env-file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Command:[docker compose --project-name roottests3latencylog-gw5 --env-file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None Executing query SELECT * FROM `test_database`.`user` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`user` LIMIT 1 FORMAT Null on instance Executing query CREATE TABLE replicated.merge_tree (id UInt64, b String) ORDER BY id on replica1 Executing query CREATE TABLE replicated.merge_tree (id UInt64, b String) ORDER BY id on replica1 http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query SHOW TABLES FROM `test_database` WHERE name = 'user' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'user' on instance http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None Executing query INSERT INTO replicated.merge_tree VALUES (100, 'abc') on replica1 Executing query INSERT INTO replicated.merge_tree VALUES (100, 'abc') on replica1 Starting new HTTP connection (5): 172.16.2.8:9001 Starting new HTTP connection (5): 172.16.2.8:9001 http://172.16.2.8:9001 "GET / HTTP/1.1" 200 0 http://172.16.2.8:9001 "GET / HTTP/1.1" 200 0 Connected to Minio. Connected to Minio. http://172.16.2.8:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.2.8:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.2.8:9001 "PUT /root HTTP/1.1" 200 0 http://172.16.2.8:9001 "PUT /root HTTP/1.1" 200 0 S3 bucket 'root' created S3 bucket 'root' created http://172.16.2.8:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.2.8:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.2.8:9001 "PUT /root2 HTTP/1.1" 200 0 http://172.16.2.8:9001 "PUT /root2 HTTP/1.1" 200 0 S3 bucket 'root2' created S3 bucket 'root2' created ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e15840f6856d267b4ff0271f9a1e4aa1d0e1b44fe8672b621e4e7241b869215e/json HTTP/1.1" 200 None ClickHouse node started ClickHouse node started Executing query CREATE TABLE simple (date Date, id UInt32) ENGINE = ReplicatedMergeTree('/clickhouse/tables/0/simple', 'node') ORDER BY tuple() PARTITION BY date; on node Executing query CREATE TABLE simple (date Date, id UInt32) ENGINE = ReplicatedMergeTree('/clickhouse/tables/0/simple', 'node') ORDER BY tuple() PARTITION BY date; on node Executing query select * from `postgres_database`.`user` order by key; on instance Executing query select * from `postgres_database`.`user` order by key; on instance Executing query DESCRIBE TABLE replicated.mysql_schema_inference_engine on replica1 Executing query DESCRIBE TABLE replicated.mysql_schema_inference_engine on replica1 Stderr: Network roottestsettingsconstraintsdistributed-gw2_default Creating Stderr: Network roottestsettingsconstraintsdistributed-gw2_default Creating Stderr: Network roottestsettingsconstraintsdistributed-gw2_default Created Stderr: Network roottestsettingsconstraintsdistributed-gw2_default Created Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Creating Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Creating Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Creating Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Creating Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Creating Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Creating Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Created Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Created Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Created Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Created Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Created Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Created Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Starting Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Starting Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Starting Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Starting Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Starting Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Starting Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Started Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Started Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Started Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Started Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Started Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-node1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-node1-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node1, ip: 172.16.8.4... Waiting for ClickHouse start in node1, ip: 172.16.8.4... http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None Executing query INSERT INTO simple VALUES ('2020-08-27', 1) on node Executing query INSERT INTO simple VALUES ('2020-08-27', 1) on node Executing query select * from `test_database`.`user` order by key; on instance Executing query select * from `test_database`.`user` order by key; on instance http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None Stderr:time="2025-04-02T02:55:26Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:55:26Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottests3latencylog-gw5_default Creating Stderr: Network roottests3latencylog-gw5_default Creating Stderr: Network roottests3latencylog-gw5_default Created Stderr: Network roottests3latencylog-gw5_default Created Stderr: Volume "roottests3latencylog-gw5_data1-1" Creating Stderr: Volume "roottests3latencylog-gw5_data1-1" Creating Stderr: Volume "roottests3latencylog-gw5_data1-1" Created Stderr: Volume "roottests3latencylog-gw5_data1-1" Created Stderr: Container roottests3latencylog-gw5-proxy2-1 Creating Stderr: Container roottests3latencylog-gw5-proxy2-1 Creating Stderr: Container roottests3latencylog-gw5-proxy1-1 Creating Stderr: Container roottests3latencylog-gw5-proxy1-1 Creating Stderr: Container roottests3latencylog-gw5-proxy1-1 Created Stderr: Container roottests3latencylog-gw5-proxy1-1 Created Stderr: Container roottests3latencylog-gw5-proxy2-1 Created Stderr: Container roottests3latencylog-gw5-proxy2-1 Created Stderr: Container roottests3latencylog-gw5-minio1-1 Creating Stderr: Container roottests3latencylog-gw5-minio1-1 Creating Stderr: Container roottests3latencylog-gw5-resolver-1 Creating Stderr: Container roottests3latencylog-gw5-resolver-1 Creating Stderr: Container roottests3latencylog-gw5-resolver-1 Created Stderr: Container roottests3latencylog-gw5-resolver-1 Created Stderr: Container roottests3latencylog-gw5-minio1-1 Created Stderr: Container roottests3latencylog-gw5-minio1-1 Created Stderr: Container roottests3latencylog-gw5-proxy2-1 Starting Stderr: Container roottests3latencylog-gw5-proxy2-1 Starting Stderr: Container roottests3latencylog-gw5-proxy1-1 Starting Stderr: Container roottests3latencylog-gw5-proxy1-1 Starting Stderr: Container roottests3latencylog-gw5-proxy2-1 Started Stderr: Container roottests3latencylog-gw5-proxy2-1 Started Stderr: Container roottests3latencylog-gw5-proxy1-1 Started Stderr: Container roottests3latencylog-gw5-proxy1-1 Started Stderr: Container roottests3latencylog-gw5-minio1-1 Starting Stderr: Container roottests3latencylog-gw5-minio1-1 Starting Stderr: Container roottests3latencylog-gw5-resolver-1 Starting Stderr: Container roottests3latencylog-gw5-resolver-1 Starting Stderr: Container roottests3latencylog-gw5-minio1-1 Started Stderr: Container roottests3latencylog-gw5-minio1-1 Started Stderr: Container roottests3latencylog-gw5-resolver-1 Started Stderr: Container roottests3latencylog-gw5-resolver-1 Started Stderr:time="2025-04-02T02:55:27Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:27Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:27Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:27Z" level=debug msg="otel error" error="" Trying to connect to Minio... Trying to connect to Minio... get_instance_ip instance_name=minio1 get_instance_ip instance_name=minio1 http://localhost:None "GET /v1.46/containers/roottests3latencylog-gw5-minio1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3latencylog-gw5-minio1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy1 get_instance_ip instance_name=proxy1 http://localhost:None "GET /v1.46/containers/roottests3latencylog-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3latencylog-gw5-proxy1-1/json HTTP/1.1" 200 None Starting new HTTP connection (1): 172.16.5.5:9001 Starting new HTTP connection (1): 172.16.5.5:9001 Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (2): 172.16.5.5:9001 Starting new HTTP connection (2): 172.16.5.5:9001 Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (3): 172.16.5.5:9001 Starting new HTTP connection (3): 172.16.5.5:9001 Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (4): 172.16.5.5:9001 Starting new HTTP connection (4): 172.16.5.5:9001 Can't connect to Minio: HTTPConnectionPool(host='172.16.5.5', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Can't connect to Minio: HTTPConnectionPool(host='172.16.5.5', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Executing query DESCRIBE TABLE replicated.mysql_schema_inference_function on replica1 Executing query DESCRIBE TABLE replicated.mysql_schema_inference_function on replica1 http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Running Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Running Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Running Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Running Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Running Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Running Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Running Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Running Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Running Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Running Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Running Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Running Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Running Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Running Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Creating Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Created Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Starting Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Started Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-node1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-node1-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node1, ip: 172.16.2.9... Waiting for ClickHouse start in node1, ip: 172.16.2.9... http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreereplicateddbttl-gw3-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance [gw0] PASSED test_postgresql_replica_database_engine_1/test.py::test_quoting_2 Executing query CREATE TABLE simple2 (date Date, id UInt32) ENGINE = ReplicatedMergeTree('/clickhouse/tables/1/simple', 'node') ORDER BY tuple() PARTITION BY date; on node Executing query CREATE TABLE simple2 (date Date, id UInt32) ENGINE = ReplicatedMergeTree('/clickhouse/tables/1/simple', 'node') ORDER BY tuple() PARTITION BY date; on node http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None Executing query SELECT id FROM mysql('mysql80:3306', 'clickhouse', 'inference_table', 'root', 'clickhouse') on replica1 Executing query SELECT id FROM mysql('mysql80:3306', 'clickhouse', 'inference_table', 'root', 'clickhouse') on replica1 Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None run container_id:roottestreloadauxiliaryzookeepers-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo1\n 2181\n \n \n zoo2\n 2181\n \n \n zoo3\n 2181\n \n 2000\n \n \n \n \n zoo1\n 2181\n \n \n zoo2\n 2181\n \n \n \n\' > /etc/clickhouse-server/conf.d/zookeeper_config.xml'] run container_id:roottestreloadauxiliaryzookeepers-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo1\n 2181\n \n \n zoo2\n 2181\n \n \n zoo3\n 2181\n \n 2000\n \n \n \n \n zoo1\n 2181\n \n \n zoo2\n 2181\n \n \n \n\' > /etc/clickhouse-server/conf.d/zookeeper_config.xml'] Command:[docker exec roottestreloadauxiliaryzookeepers-gw6-node-1 bash -c echo ' zoo1 2181 zoo2 2181 zoo3 2181 2000 zoo1 2181 zoo2 2181 ' > /etc/clickhouse-server/conf.d/zookeeper_config.xml] Command:[docker exec roottestreloadauxiliaryzookeepers-gw6-node-1 bash -c echo ' zoo1 2181 zoo2 2181 zoo3 2181 2000 zoo1 2181 zoo2 2181 ' > /etc/clickhouse-server/conf.d/zookeeper_config.xml] http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None Executing query SYSTEM RELOAD CONFIG on node Executing query SYSTEM RELOAD CONFIG on node http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None Executing query SELECT id FROM replicated.mysql_schema_inference_engine on replica1 Executing query SELECT id FROM replicated.mysql_schema_inference_engine on replica1 http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Starting new HTTP connection (5): 172.16.5.5:9001 Starting new HTTP connection (5): 172.16.5.5:9001 http://172.16.5.5:9001 "GET / HTTP/1.1" 200 0 http://172.16.5.5:9001 "GET / HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None Connected to Minio. Connected to Minio. http://172.16.5.5:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.5.5:9001 "GET /root?location= HTTP/1.1" 404 0 Executing query SELECT id FROM replicated.mysql_schema_inference_function on replica1 Executing query SELECT id FROM replicated.mysql_schema_inference_function on replica1 http://172.16.5.5:9001 "PUT /root HTTP/1.1" 200 0 http://172.16.5.5:9001 "PUT /root HTTP/1.1" 200 0 S3 bucket 'root' created S3 bucket 'root' created http://172.16.5.5:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.5.5:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.5.5:9001 "PUT /root2 HTTP/1.1" 200 0 http://172.16.5.5:9001 "PUT /root2 HTTP/1.1" 200 0 S3 bucket 'root2' created S3 bucket 'root2' created ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/.env --project-name roottests3latencylog-gw5 --file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/.env --project-name roottests3latencylog-gw5 --file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/.env --project-name roottests3latencylog-gw5 --file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/.env --project-name roottests3latencylog-gw5 --file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index Executing query INSERT INTO postgres_database.postgresql_replica SELECT number, number, number, number from numbers(50, 10) on instance Executing query INSERT INTO postgres_database.postgresql_replica SELECT number, number, number, number from numbers(50, 10) on instance http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None Executing query SELECT id FROM replicated.merge_tree on replica1 Executing query SELECT id FROM replicated.merge_tree on replica1 http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None Stderr: Container roottests3latencylog-gw5-proxy2-1 Running Stderr: Container roottests3latencylog-gw5-proxy2-1 Running Stderr: Container roottests3latencylog-gw5-proxy1-1 Running Stderr: Container roottests3latencylog-gw5-proxy1-1 Running Stderr: Container roottests3latencylog-gw5-resolver-1 Running Stderr: Container roottests3latencylog-gw5-resolver-1 Running Stderr: Container roottests3latencylog-gw5-minio1-1 Running Stderr: Container roottests3latencylog-gw5-minio1-1 Running Stderr: Container roottests3latencylog-gw5-node-1 Creating Stderr: Container roottests3latencylog-gw5-node-1 Creating Stderr: Container roottests3latencylog-gw5-node-1 Created Stderr: Container roottests3latencylog-gw5-node-1 Created Stderr: Container roottests3latencylog-gw5-node-1 Starting Stderr: Container roottests3latencylog-gw5-node-1 Starting Stderr: Container roottests3latencylog-gw5-node-1 Started Stderr: Container roottests3latencylog-gw5-node-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottests3latencylog-gw5-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3latencylog-gw5-node-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottests3latencylog-gw5-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3latencylog-gw5-node-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node, ip: 172.16.5.6... Waiting for ClickHouse start in node, ip: 172.16.5.6... http://localhost:None "GET /v1.46/containers/roottests3latencylog-gw5-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3latencylog-gw5-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None Executing query CREATE DICTIONARY replicated.dict1 (id INT, data String) PRIMARY KEY id SOURCE(MYSQL(HOST 'mysql80' PORT 3306 USER 'root' PASSWORD 'clickhouse' DB 'clickhouse' TABLE 'inference_table'))LAYOUT(FLAT()) LIFETIME(MIN 0 MAX 10) on replica1 Executing query CREATE DICTIONARY replicated.dict1 (id INT, data String) PRIMARY KEY id SOURCE(MYSQL(HOST 'mysql80' PORT 3306 USER 'root' PASSWORD 'clickhouse' DB 'clickhouse' TABLE 'inference_table'))LAYOUT(FLAT()) LIFETIME(MIN 0 MAX 10) on replica1 http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None Executing query CREATE DICTIONARY replicated.dict2 (name String, value UInt32) PRIMARY KEY value SOURCE(CLICKHOUSE(HOST '127.0.0.2' PORT 9000 USER 'default' PASSWORD '' DB 'replicated' TABLE 'example_s3_engine_table'))LAYOUT(FLAT()) LIFETIME(MIN 0 MAX 10) on replica1 Executing query CREATE DICTIONARY replicated.dict2 (name String, value UInt32) PRIMARY KEY value SOURCE(CLICKHOUSE(HOST '127.0.0.2' PORT 9000 USER 'default' PASSWORD '' DB 'replicated' TABLE 'example_s3_engine_table'))LAYOUT(FLAT()) LIFETIME(MIN 0 MAX 10) on replica1 http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/20336abb5239522c0e503bfc06599071f309d516fe90963028283d4f671924f3/json HTTP/1.1" 200 None ClickHouse node1 started ClickHouse node1 started get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-node2-1/json HTTP/1.1" 200 None Executing query select name, create_query from system.resources order by all on node get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 Executing query select name, create_query from system.resources order by all on node http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-node2-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node2, ip: 172.16.8.2... Waiting for ClickHouse start in node2, ip: 172.16.8.2... http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d054fa5772fd8448aa5dbbe3041d165389d75f5dc12daf5e2d304c5d3d8b7741/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d054fa5772fd8448aa5dbbe3041d165389d75f5dc12daf5e2d304c5d3d8b7741/json HTTP/1.1" 200 None ClickHouse node2 started ClickHouse node2 started get_instance_ip instance_name=distributed get_instance_ip instance_name=distributed http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-distributed-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-distributed-1/json HTTP/1.1" 200 None get_instance_ip instance_name=distributed get_instance_ip instance_name=distributed http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-distributed-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-distributed-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in distributed, ip: 172.16.8.3... Waiting for ClickHouse start in distributed, ip: 172.16.8.3... http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-distributed-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-distributed-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9237f2cb75b7abcc8ae29e04ad872d945f54c440b126fc4359a64364b1c796ef/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/9237f2cb75b7abcc8ae29e04ad872d945f54c440b126fc4359a64364b1c796ef/json HTTP/1.1" 200 None ClickHouse distributed started ClickHouse distributed started Executing query CREATE USER shard on node1 Executing query CREATE USER shard on node1 http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None Executing query GRANT ALL ON *.* TO shard on node1 Executing query GRANT ALL ON *.* TO shard on node1 http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None Executing query CREATE DICTIONARY replicated.dict3 (name String, value UInt32) PRIMARY KEY value SOURCE(CLICKHOUSE(USER 'default' PASSWORD '' DB 'replicated' TABLE 'example_s3_engine_table'))LAYOUT(FLAT()) LIFETIME(MIN 0 MAX 10) on replica1 Executing query CREATE DICTIONARY replicated.dict3 (name String, value UInt32) PRIMARY KEY value SOURCE(CLICKHOUSE(USER 'default' PASSWORD '' DB 'replicated' TABLE 'example_s3_engine_table'))LAYOUT(FLAT()) LIFETIME(MIN 0 MAX 10) on replica1 Executing query INSERT INTO postgres_database.postgresql_replica SELECT number, number, number, number from numbers(100, 10) on instance Executing query INSERT INTO postgres_database.postgresql_replica SELECT number, number, number, number from numbers(100, 10) on instance Executing query select name, create_query from system.resources order by all on node2 Executing query select name, create_query from system.resources order by all on node2 http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f27ea68c0c616fa8cea0b362ab307728f09f5f94b2e6db18f7a06ba4595f23be/json HTTP/1.1" 200 None ClickHouse node1 started ClickHouse node1 started Executing query CREATE USER shard on node2 Executing query CREATE USER shard on node2 Executing query DROP DATABASE default on node1 Executing query DROP DATABASE default on node1 http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None Executing query SELECT * FROM `test_database`.`postgresql_replica` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica` LIMIT 1 FORMAT Null on instance Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None Executing query SYSTEM SYNC DATABASE REPLICA replicated on replica2 Executing query SYSTEM SYNC DATABASE REPLICA replicated on replica2 Executing query GRANT ALL ON *.* TO shard on node2 Executing query GRANT ALL ON *.* TO shard on node2 Executing query CREATE DATABASE default ENGINE Replicated('/replicated') on node1 Executing query CREATE DATABASE default ENGINE Replicated('/replicated') on node1 http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None Executing query BACKUP DATABASE replicated TO Disk('backups', '1/') on replica2 Executing query BACKUP DATABASE replicated TO Disk('backups', '1/') on replica2 Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica' on instance Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None Executing query CREATE ROLE admin on distributed Executing query CREATE ROLE admin on distributed Executing query CREATE TABLE 02908_main (a UInt32) ENGINE = ReplicatedMergeTree ORDER BY a on node1 Executing query CREATE TABLE 02908_main (a UInt32) ENGINE = ReplicatedMergeTree ORDER BY a on node1 http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None Executing query GRANT ALL ON *.* TO admin on distributed Executing query GRANT ALL ON *.* TO admin on distributed Executing query select * from `postgres_database`.`postgresql_replica` order by key1; on instance Executing query select * from `postgres_database`.`postgresql_replica` order by key1; on instance http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/3503d8bd66978a4f55f37ee17c54fd576c85fede772047a0a2d52908fa3de586/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/3503d8bd66978a4f55f37ee17c54fd576c85fede772047a0a2d52908fa3de586/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None Executing query DROP DICTIONARY IF EXISTS replicated.dict3 SYNC on replica2 Executing query DROP DICTIONARY IF EXISTS replicated.dict3 SYNC on replica2 http://localhost:None "GET /v1.46/exec/3503d8bd66978a4f55f37ee17c54fd576c85fede772047a0a2d52908fa3de586/json HTTP/1.1" 200 461 http://localhost:None "GET /v1.46/exec/3503d8bd66978a4f55f37ee17c54fd576c85fede772047a0a2d52908fa3de586/json HTTP/1.1" 200 461 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/305287d1ab53d4f6008e40177d9e4a13f27a0805e30d109966fe10458add4408/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/305287d1ab53d4f6008e40177d9e4a13f27a0805e30d109966fe10458add4408/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/305287d1ab53d4f6008e40177d9e4a13f27a0805e30d109966fe10458add4408/json HTTP/1.1" 200 461 http://localhost:None "GET /v1.46/exec/305287d1ab53d4f6008e40177d9e4a13f27a0805e30d109966fe10458add4408/json HTTP/1.1" 200 461 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): Executing query drop workload B2; on node Executing query drop workload B2; on node http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None Executing query CREATE TABLE 02908_dependent (a UInt32, ts DateTime) ENGINE = ReplicatedMergeTree ORDER BY a TTL ts + 1 WHERE a IN (SELECT a FROM 02908_main) on node1 Executing query CREATE TABLE 02908_dependent (a UInt32, ts DateTime) ENGINE = ReplicatedMergeTree ORDER BY a TTL ts + 1 WHERE a IN (SELECT a FROM 02908_main) on node1 Executing query CREATE TABLE shard_settings (name String, value String) ENGINE = Distributed(test_cluster, system, settings); on distributed Executing query CREATE TABLE shard_settings (name String, value String) ENGINE = Distributed(test_cluster, system, settings); on distributed http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None Executing query select * from `test_database`.`postgresql_replica` order by key1; on instance Executing query select * from `test_database`.`postgresql_replica` order by key1; on instance http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/6cef8b7ea891b4cc255bcd763d14c242dc41b1eabcdeee7038475292e0ec88b6/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/6cef8b7ea891b4cc255bcd763d14c242dc41b1eabcdeee7038475292e0ec88b6/start HTTP/1.1" 101 0 Executing query DROP DICTIONARY IF EXISTS replicated.dict2 SYNC on replica2 Executing query DROP DICTIONARY IF EXISTS replicated.dict2 SYNC on replica2 run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps -C clickhouse] http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/exec/6cef8b7ea891b4cc255bcd763d14c242dc41b1eabcdeee7038475292e0ec88b6/json HTTP/1.1" 200 457 http://localhost:None "GET /v1.46/exec/6cef8b7ea891b4cc255bcd763d14c242dc41b1eabcdeee7038475292e0ec88b6/json HTTP/1.1" 200 457 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/19f5f99decc974d064953c199c9caed25b61c523e60ccbff2818ffecf14a9e22/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/19f5f99decc974d064953c199c9caed25b61c523e60ccbff2818ffecf14a9e22/start HTTP/1.1" 101 0 Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 8 ? 00:00:02 clickhouse Stdout: 8 ? 00:00:02 clickhouse run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c pkill clickhouse] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/exec/19f5f99decc974d064953c199c9caed25b61c523e60ccbff2818ffecf14a9e22/json HTTP/1.1" 200 457 http://localhost:None "GET /v1.46/exec/19f5f99decc974d064953c199c9caed25b61c523e60ccbff2818ffecf14a9e22/json HTTP/1.1" 200 457 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f159e69f88e6646a0336df47a2abe810795408bca77e2265026d458250b27374/json HTTP/1.1" 200 None ClickHouse node started ClickHouse node started Cluster started Cluster started Starting custom S3 endpoint Starting custom S3 endpoint Starting mock server endpoint.py Starting mock server endpoint.py Stdout:8 Stdout:8 run container_id:roottests3latencylog-gw5-resolver-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname endpoint.py) && echo IyEvdXNyL2Jpbi9lbnYgcHl0aG9uMwppbXBvcnQgdGltZQoKZnJvbSBib3R0bGUgaW1wb3J0IHJlcXVlc3QsIHJlc3BvbnNlLCByb3V0ZSwgcnVuCgp0b3RhbCA9IDAKCgpkZWYgdGhyb3R0bGVfYW5kX2NvdW50KCk6CiAgICBnbG9iYWwgdG90YWwKICAgIHRvdGFsICs9IDEKICAgIHRpbWUuc2xlZXAoMSkKCgojIEhhbmRsZSBmb3IgTXVsdGlwbGVPYmplY3RzRGVsZXRlLgpAcm91dGUoIi88X2J1Y2tldD4iLCBbIlBPU1QiXSkKZGVmIGRlbGV0ZShfYnVja2V0KToKICAgIHRocm90dGxlX2FuZF9jb3VudCgpCiAgICByZXNwb25zZS5zZXRfaGVhZGVyKAogICAgICAgICJMb2NhdGlvbiIsICJodHRwOi8vbWluaW8xOjkwMDEvIiArIF9idWNrZXQgKyAiPyIgKyByZXF1ZXN0LnF1ZXJ5X3N0cmluZwogICAgKQogICAgcmVzcG9uc2Uuc3RhdHVzID0gMzA3CiAgICByZXR1cm4gIlJlZGlyZWN0ZWQiCgoKQHJvdXRlKCIvPF9idWNrZXQ+LzxfcGF0aDpwYXRoPiIsIFsiR0VUIiwgIlBPU1QiLCAiUFVUIiwgIkRFTEVURSJdKQpkZWYgc2VydmVyKF9idWNrZXQsIF9wYXRoKToKICAgIHRocm90dGxlX2FuZF9jb3VudCgpCiAgICByZXNwb25zZS5zZXRfaGVhZGVyKAogICAgICAgICJMb2NhdGlvbiIsCiAgICAgICAgImh0dHA6Ly9taW5pbzE6OTAwMS8iICsgX2J1Y2tldCArICIvIiArIF9wYXRoICsgIj8iICsgcmVxdWVzdC5xdWVyeV9zdHJpbmcsCiAgICApCiAgICByZXNwb25zZS5zdGF0dXMgPSAzMDcKICAgIHJldHVybiAiUmVkaXJlY3RlZCIKCgpAcm91dGUoIi90b3RhbCIsIFsiR0VUIl0pCmRlZiBnZXRfdG90YWwoKToKICAgIGdsb2JhbCB0b3RhbAogICAgcmV0dXJuIHN0cih0b3RhbCkKCgpAcm91dGUoIi8iKQpkZWYgcGluZygpOgogICAgcmV0dXJuICJPSyIKCgpydW4oaG9zdD0iMC4wLjAuMCIsIHBvcnQ9ODA4MCkK | base64 --decode > endpoint.py'] run container_id:roottests3latencylog-gw5-resolver-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname endpoint.py) && echo IyEvdXNyL2Jpbi9lbnYgcHl0aG9uMwppbXBvcnQgdGltZQoKZnJvbSBib3R0bGUgaW1wb3J0IHJlcXVlc3QsIHJlc3BvbnNlLCByb3V0ZSwgcnVuCgp0b3RhbCA9IDAKCgpkZWYgdGhyb3R0bGVfYW5kX2NvdW50KCk6CiAgICBnbG9iYWwgdG90YWwKICAgIHRvdGFsICs9IDEKICAgIHRpbWUuc2xlZXAoMSkKCgojIEhhbmRsZSBmb3IgTXVsdGlwbGVPYmplY3RzRGVsZXRlLgpAcm91dGUoIi88X2J1Y2tldD4iLCBbIlBPU1QiXSkKZGVmIGRlbGV0ZShfYnVja2V0KToKICAgIHRocm90dGxlX2FuZF9jb3VudCgpCiAgICByZXNwb25zZS5zZXRfaGVhZGVyKAogICAgICAgICJMb2NhdGlvbiIsICJodHRwOi8vbWluaW8xOjkwMDEvIiArIF9idWNrZXQgKyAiPyIgKyByZXF1ZXN0LnF1ZXJ5X3N0cmluZwogICAgKQogICAgcmVzcG9uc2Uuc3RhdHVzID0gMzA3CiAgICByZXR1cm4gIlJlZGlyZWN0ZWQiCgoKQHJvdXRlKCIvPF9idWNrZXQ+LzxfcGF0aDpwYXRoPiIsIFsiR0VUIiwgIlBPU1QiLCAiUFVUIiwgIkRFTEVURSJdKQpkZWYgc2VydmVyKF9idWNrZXQsIF9wYXRoKToKICAgIHRocm90dGxlX2FuZF9jb3VudCgpCiAgICByZXNwb25zZS5zZXRfaGVhZGVyKAogICAgICAgICJMb2NhdGlvbiIsCiAgICAgICAgImh0dHA6Ly9taW5pbzE6OTAwMS8iICsgX2J1Y2tldCArICIvIiArIF9wYXRoICsgIj8iICsgcmVxdWVzdC5xdWVyeV9zdHJpbmcsCiAgICApCiAgICByZXNwb25zZS5zdGF0dXMgPSAzMDcKICAgIHJldHVybiAiUmVkaXJlY3RlZCIKCgpAcm91dGUoIi90b3RhbCIsIFsiR0VUIl0pCmRlZiBnZXRfdG90YWwoKToKICAgIGdsb2JhbCB0b3RhbAogICAgcmV0dXJuIHN0cih0b3RhbCkKCgpAcm91dGUoIi8iKQpkZWYgcGluZygpOgogICAgcmV0dXJuICJPSyIKCgpydW4oaG9zdD0iMC4wLjAuMCIsIHBvcnQ9ODA4MCkK | base64 --decode > endpoint.py'] Command:[docker exec roottests3latencylog-gw5-resolver-1 bash -c mkdir -p $(dirname endpoint.py) && echo IyEvdXNyL2Jpbi9lbnYgcHl0aG9uMwppbXBvcnQgdGltZQoKZnJvbSBib3R0bGUgaW1wb3J0IHJlcXVlc3QsIHJlc3BvbnNlLCByb3V0ZSwgcnVuCgp0b3RhbCA9IDAKCgpkZWYgdGhyb3R0bGVfYW5kX2NvdW50KCk6CiAgICBnbG9iYWwgdG90YWwKICAgIHRvdGFsICs9IDEKICAgIHRpbWUuc2xlZXAoMSkKCgojIEhhbmRsZSBmb3IgTXVsdGlwbGVPYmplY3RzRGVsZXRlLgpAcm91dGUoIi88X2J1Y2tldD4iLCBbIlBPU1QiXSkKZGVmIGRlbGV0ZShfYnVja2V0KToKICAgIHRocm90dGxlX2FuZF9jb3VudCgpCiAgICByZXNwb25zZS5zZXRfaGVhZGVyKAogICAgICAgICJMb2NhdGlvbiIsICJodHRwOi8vbWluaW8xOjkwMDEvIiArIF9idWNrZXQgKyAiPyIgKyByZXF1ZXN0LnF1ZXJ5X3N0cmluZwogICAgKQogICAgcmVzcG9uc2Uuc3RhdHVzID0gMzA3CiAgICByZXR1cm4gIlJlZGlyZWN0ZWQiCgoKQHJvdXRlKCIvPF9idWNrZXQ+LzxfcGF0aDpwYXRoPiIsIFsiR0VUIiwgIlBPU1QiLCAiUFVUIiwgIkRFTEVURSJdKQpkZWYgc2VydmVyKF9idWNrZXQsIF9wYXRoKToKICAgIHRocm90dGxlX2FuZF9jb3VudCgpCiAgICByZXNwb25zZS5zZXRfaGVhZGVyKAogICAgICAgICJMb2NhdGlvbiIsCiAgICAgICAgImh0dHA6Ly9taW5pbzE6OTAwMS8iICsgX2J1Y2tldCArICIvIiArIF9wYXRoICsgIj8iICsgcmVxdWVzdC5xdWVyeV9zdHJpbmcsCiAgICApCiAgICByZXNwb25zZS5zdGF0dXMgPSAzMDcKICAgIHJldHVybiAiUmVkaXJlY3RlZCIKCgpAcm91dGUoIi90b3RhbCIsIFsiR0VUIl0pCmRlZiBnZXRfdG90YWwoKToKICAgIGdsb2JhbCB0b3RhbAogICAgcmV0dXJuIHN0cih0b3RhbCkKCgpAcm91dGUoIi8iKQpkZWYgcGluZygpOgogICAgcmV0dXJuICJPSyIKCgpydW4oaG9zdD0iMC4wLjAuMCIsIHBvcnQ9ODA4MCkK | base64 --decode > endpoint.py] Command:[docker exec roottests3latencylog-gw5-resolver-1 bash -c mkdir -p $(dirname endpoint.py) && echo IyEvdXNyL2Jpbi9lbnYgcHl0aG9uMwppbXBvcnQgdGltZQoKZnJvbSBib3R0bGUgaW1wb3J0IHJlcXVlc3QsIHJlc3BvbnNlLCByb3V0ZSwgcnVuCgp0b3RhbCA9IDAKCgpkZWYgdGhyb3R0bGVfYW5kX2NvdW50KCk6CiAgICBnbG9iYWwgdG90YWwKICAgIHRvdGFsICs9IDEKICAgIHRpbWUuc2xlZXAoMSkKCgojIEhhbmRsZSBmb3IgTXVsdGlwbGVPYmplY3RzRGVsZXRlLgpAcm91dGUoIi88X2J1Y2tldD4iLCBbIlBPU1QiXSkKZGVmIGRlbGV0ZShfYnVja2V0KToKICAgIHRocm90dGxlX2FuZF9jb3VudCgpCiAgICByZXNwb25zZS5zZXRfaGVhZGVyKAogICAgICAgICJMb2NhdGlvbiIsICJodHRwOi8vbWluaW8xOjkwMDEvIiArIF9idWNrZXQgKyAiPyIgKyByZXF1ZXN0LnF1ZXJ5X3N0cmluZwogICAgKQogICAgcmVzcG9uc2Uuc3RhdHVzID0gMzA3CiAgICByZXR1cm4gIlJlZGlyZWN0ZWQiCgoKQHJvdXRlKCIvPF9idWNrZXQ+LzxfcGF0aDpwYXRoPiIsIFsiR0VUIiwgIlBPU1QiLCAiUFVUIiwgIkRFTEVURSJdKQpkZWYgc2VydmVyKF9idWNrZXQsIF9wYXRoKToKICAgIHRocm90dGxlX2FuZF9jb3VudCgpCiAgICByZXNwb25zZS5zZXRfaGVhZGVyKAogICAgICAgICJMb2NhdGlvbiIsCiAgICAgICAgImh0dHA6Ly9taW5pbzE6OTAwMS8iICsgX2J1Y2tldCArICIvIiArIF9wYXRoICsgIj8iICsgcmVxdWVzdC5xdWVyeV9zdHJpbmcsCiAgICApCiAgICByZXNwb25zZS5zdGF0dXMgPSAzMDcKICAgIHJldHVybiAiUmVkaXJlY3RlZCIKCgpAcm91dGUoIi90b3RhbCIsIFsiR0VUIl0pCmRlZiBnZXRfdG90YWwoKToKICAgIGdsb2JhbCB0b3RhbAogICAgcmV0dXJuIHN0cih0b3RhbCkKCgpAcm91dGUoIi8iKQpkZWYgcGluZygpOgogICAgcmV0dXJuICJPSyIKCgpydW4oaG9zdD0iMC4wLjAuMCIsIHBvcnQ9ODA4MCkK | base64 --decode > endpoint.py] Executing query INSERT INTO 02908_main VALUES (1) on node1 Executing query INSERT INTO 02908_main VALUES (1) on node1 Executing query SELECT * FROM `test_database`.`postgresql_replica` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica` LIMIT 1 FORMAT Null on instance run container_id:roottests3latencylog-gw5-resolver-1 detach:True nothrow:False cmd: ['bash', '-c', 'python3 endpoint.py 8080 >/var/log/resolver/endpoint.log 2>/var/log/resolver/endpoint.err.log'] run container_id:roottests3latencylog-gw5-resolver-1 detach:True nothrow:False cmd: ['bash', '-c', 'python3 endpoint.py 8080 >/var/log/resolver/endpoint.log 2>/var/log/resolver/endpoint.err.log'] Command:[docker exec roottests3latencylog-gw5-resolver-1 bash -c python3 endpoint.py 8080 >/var/log/resolver/endpoint.log 2>/var/log/resolver/endpoint.err.log] Command:[docker exec roottests3latencylog-gw5-resolver-1 bash -c python3 endpoint.py 8080 >/var/log/resolver/endpoint.log 2>/var/log/resolver/endpoint.err.log] run container_id:roottests3latencylog-gw5-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] run container_id:roottests3latencylog-gw5-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] Command:[docker exec roottests3latencylog-gw5-resolver-1 curl -s http://localhost:8080/] Command:[docker exec roottests3latencylog-gw5-resolver-1 curl -s http://localhost:8080/] Exitcode:7 Exitcode:7 Executing query DROP DICTIONARY IF EXISTS replicated.dict1 SYNC on replica2 Executing query DROP DICTIONARY IF EXISTS replicated.dict1 SYNC on replica2 Executing query INSERT INTO 02908_dependent VALUES (1, now()) on node1 Executing query INSERT INTO 02908_dependent VALUES (1, now()) on node1 http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica' on instance Executing query DROP TABLE replicated.example_s3_engine_table on replica2 Executing query SELECT * FROM 02908_dependent on node1 Executing query DROP TABLE replicated.example_s3_engine_table on replica2 Executing query SELECT * FROM 02908_dependent on node1 Executing query select name, create_query from system.resources order by all on node Executing query select name, create_query from system.resources order by all on node Executing query select * from `postgres_database`.`postgresql_replica` order by key1; on instance Executing query select * from `postgres_database`.`postgresql_replica` order by key1; on instance Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] [gw3] PASSED test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl Executing query select name, create_query from system.resources order by all on node2 Executing query select name, create_query from system.resources order by all on node2 Executing query select * from `test_database`.`postgresql_replica` order by key1; on instance Executing query select * from `test_database`.`postgresql_replica` order by key1; on instance Executing query DROP TABLE replicated.mysql_schema_inference_engine on replica2 Executing query DROP TABLE replicated.mysql_schema_inference_engine on replica2 run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8 Stdout:8 Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node Executing query SELECT * FROM `test_database`.`postgresql_replica` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica` LIMIT 1 FORMAT Null on instance run container_id:roottests3latencylog-gw5-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] run container_id:roottests3latencylog-gw5-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] Command:[docker exec roottests3latencylog-gw5-resolver-1 curl -s http://localhost:8080/] Command:[docker exec roottests3latencylog-gw5-resolver-1 curl -s http://localhost:8080/] Executing query DROP TABLE replicated.mysql_schema_inference_function on replica2 Executing query DROP TABLE replicated.mysql_schema_inference_function on replica2 Stdout:OK Stdout:OK endpoint.py answered OK on attempt 2 endpoint.py answered OK on attempt 2 Mock server endpoint.py started Mock server endpoint.py started S3 endpoint started S3 endpoint started Executing query CREATE TABLE s3_latency_log_test ( id Int64, data String ) ENGINE=MergeTree() ORDER BY id SETTINGS storage_policy='s3' on node Executing query CREATE TABLE s3_latency_log_test ( id Int64, data String ) ENGINE=MergeTree() ORDER BY id SETTINGS storage_policy='s3' on node http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfproxy-gw4-proxy1-1/json HTTP/1.1" 200 None Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica' on instance Executing query SYSTEM SYNC DATABASE REPLICA replicated on replica3 Executing query SYSTEM SYNC DATABASE REPLICA replicated on replica3 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/b99158e95dfdc32dee9c7f98819b26badc7893c409cd9cc195c8319e8887834f/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/b99158e95dfdc32dee9c7f98819b26badc7893c409cd9cc195c8319e8887834f/start HTTP/1.1" 101 0 Executing query select * from `postgres_database`.`postgresql_replica` order by key1; on instance Executing query select * from `postgres_database`.`postgresql_replica` order by key1; on instance http://localhost:None "GET /v1.46/exec/b99158e95dfdc32dee9c7f98819b26badc7893c409cd9cc195c8319e8887834f/json HTTP/1.1" 200 461 http://localhost:None "GET /v1.46/exec/b99158e95dfdc32dee9c7f98819b26badc7893c409cd9cc195c8319e8887834f/json HTTP/1.1" 200 461 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/728ace98f55a9bbcdecb8af275fadfb4059d46245fb24afa0b3b9819eb378776/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/728ace98f55a9bbcdecb8af275fadfb4059d46245fb24afa0b3b9819eb378776/start HTTP/1.1" 101 0 Executing query EXISTS replicated.mysql_schema_inference_engine on replica3 http://localhost:None "GET /v1.46/exec/728ace98f55a9bbcdecb8af275fadfb4059d46245fb24afa0b3b9819eb378776/json HTTP/1.1" 200 461 Executing query EXISTS replicated.mysql_schema_inference_engine on replica3 http://localhost:None "GET /v1.46/exec/728ace98f55a9bbcdecb8af275fadfb4059d46245fb24afa0b3b9819eb378776/json HTTP/1.1" 200 461 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): Executing query drop workload C2; on node Executing query drop workload C2; on node Executing query select * from `test_database`.`postgresql_replica` order by key1; on instance Executing query select * from `test_database`.`postgresql_replica` order by key1; on instance Executing query drop workload D2; on node Executing query drop workload D2; on node Executing query EXISTS replicated.mysql_schema_inference_function on replica3 Executing query EXISTS replicated.mysql_schema_inference_function on replica3 run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query drop workload A3; on node Executing query drop workload A3; on node No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-distributed-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-distributed-1/exec HTTP/1.1" 201 74 Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance [gw0] PASSED test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index http://localhost:None "POST /v1.46/exec/a474580784e54423885abb8eaeb824cab288808267e37110706648467c9747bd/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/a474580784e54423885abb8eaeb824cab288808267e37110706648467c9747bd/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/a474580784e54423885abb8eaeb824cab288808267e37110706648467c9747bd/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/a474580784e54423885abb8eaeb824cab288808267e37110706648467c9747bd/json HTTP/1.1" 200 586 Executing query RESTORE DATABASE replicated FROM Disk('backups', '1/') SETTINGS allow_different_database_def=true on replica3 Executing query RESTORE DATABASE replicated FROM Disk('backups', '1/') SETTINGS allow_different_database_def=true on replica3 Executing query ALTER TABLE simple2 FETCH PARTITION '2020-08-27' FROM 'zookeeper2:/clickhouse/tables/0/simple'; on node Executing query ALTER TABLE simple2 FETCH PARTITION '2020-08-27' FROM 'zookeeper2:/clickhouse/tables/0/simple'; on node Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/.env --project-name roottests3storageconfproxy-gw4 --file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/.env --project-name roottests3storageconfproxy-gw4 --file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] [gw4] PASSED test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver] Executing query drop workload B3; on node Executing query drop workload B3; on node Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query SYSTEM FLUSH LOGS on node Executing query SYSTEM FLUSH LOGS on node Executing query ALTER TABLE simple2 ATTACH PARTITION '2020-08-27'; on node Executing query ALTER TABLE simple2 ATTACH PARTITION '2020-08-27'; on node Executing query drop workload C3; on node Executing query drop workload C3; on node Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query SELECT id FROM simple2 on node Executing query SELECT id FROM simple2 on node Executing query SYSTEM SYNC DATABASE REPLICA replicated on replica1 Executing query SYSTEM SYNC DATABASE REPLICA replicated on replica1 Executing query drop workload D3; on node Executing query drop workload D3; on node Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query SELECT engine FROM system.tables where database = 'replicated' and name = 'example_s3_engine_table' on replica1 Executing query SELECT engine FROM system.tables where database = 'replicated' and name = 'example_s3_engine_table' on replica1 Executing query drop workload X; on node Executing query drop workload X; on node run container_id:roottestreloadauxiliaryzookeepers-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo2\n 2181\n \n 2000\n \n\' > /etc/clickhouse-server/conf.d/zookeeper_config.xml'] run container_id:roottestreloadauxiliaryzookeepers-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo \'\n \n \n zoo2\n 2181\n \n 2000\n \n\' > /etc/clickhouse-server/conf.d/zookeeper_config.xml'] Command:[docker exec roottestreloadauxiliaryzookeepers-gw6-node-1 bash -c echo ' zoo2 2181 2000 ' > /etc/clickhouse-server/conf.d/zookeeper_config.xml] Command:[docker exec roottestreloadauxiliaryzookeepers-gw6-node-1 bash -c echo ' zoo2 2181 2000 ' > /etc/clickhouse-server/conf.d/zookeeper_config.xml] Executing query SYSTEM RELOAD CONFIG on node Executing query SYSTEM RELOAD CONFIG on node test_postgresql_replica_database_engine_1/test.py::test_replicating_dml Executing query INSERT INTO postgres_database.postgresql_replica_0 SELECT number, 0 from numbers(50) on instance Executing query INSERT INTO postgres_database.postgresql_replica_0 SELECT number, 0 from numbers(50) on instance run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query drop workload Y; on node Executing query drop workload Y; on node Stdout:740 Stdout:740 Clickhouse process running. Clickhouse process running. run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:740 Stdout:740 Executing query select 20 on distributed Executing query select 20 on distributed Executing query SELECT count(), sum(id) FROM replicated.mysql_schema_inference_engine on replica1 Executing query SELECT count(), sum(id) FROM replicated.mysql_schema_inference_engine on replica1 Executing query INSERT INTO postgres_database.postgresql_replica_1 SELECT number, 1 from numbers(50) on instance Executing query INSERT INTO postgres_database.postgresql_replica_1 SELECT number, 1 from numbers(50) on instance Executing query drop workload Z; on node Executing query drop workload Z; on node Executing query SELECT (LatencyEvent_S3ConnectMicroseconds, LatencyEvent_S3FirstByteWriteAttempt1Microseconds, LatencyEvent_S3FirstByteWriteAttempt2Microseconds, LatencyEvent_S3FirstByteWriteAttemptNMicroseconds) FROM system.latency_log ORDER BY event_time_microseconds DESC LIMIT 1 on node Executing query SELECT (LatencyEvent_S3ConnectMicroseconds, LatencyEvent_S3FirstByteWriteAttempt1Microseconds, LatencyEvent_S3FirstByteWriteAttempt2Microseconds, LatencyEvent_S3FirstByteWriteAttemptNMicroseconds) FROM system.latency_log ORDER BY event_time_microseconds DESC LIMIT 1 on node Executing query SELECT count(), sum(id) FROM replicated.mysql_schema_inference_function on replica1 Executing query SELECT count(), sum(id) FROM replicated.mysql_schema_inference_function on replica1 Executing query drop workload all; on node Executing query drop workload all; on node Executing query INSERT INTO postgres_database.postgresql_replica_2 SELECT number, 2 from numbers(50) on instance Executing query INSERT INTO postgres_database.postgresql_replica_2 SELECT number, 2 from numbers(50) on instance Executing query WITH (SELECT LatencyEvent_DiskS3ConnectMicroseconds FROM system.latency_buckets) AS buckets SELECT format('[{}]', arrayStringConcat(arrayMap((t, c) -> format('({},{})', toString(t), c), buckets, LatencyEvent_DiskS3ConnectMicroseconds), ',')) FROM system.latency_log ORDER BY event_time_microseconds DESC LIMIT 1 on node Executing query WITH (SELECT LatencyEvent_DiskS3ConnectMicroseconds FROM system.latency_buckets) AS buckets SELECT format('[{}]', arrayStringConcat(arrayMap((t, c) -> format('({},{})', toString(t), c), buckets, LatencyEvent_DiskS3ConnectMicroseconds), ',')) FROM system.latency_log ORDER BY event_time_microseconds DESC LIMIT 1 on node http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 Executing query SELECT count(), sum(id) FROM replicated.merge_tree on replica1 Executing query SELECT count(), sum(id) FROM replicated.merge_tree on replica1 http://localhost:None "POST /v1.46/exec/444ae1d466401307daca7c48d1523832eaf76c71b68b47b9c1fd96b97088cee5/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/444ae1d466401307daca7c48d1523832eaf76c71b68b47b9c1fd96b97088cee5/start HTTP/1.1" 101 0 Executing query select 20 on distributed Executing query select 20 on distributed Executing query INSERT INTO postgres_database.postgresql_replica_3 SELECT number, 3 from numbers(50) on instance Executing query INSERT INTO postgres_database.postgresql_replica_3 SELECT number, 3 from numbers(50) on instance http://localhost:None "GET /v1.46/exec/444ae1d466401307daca7c48d1523832eaf76c71b68b47b9c1fd96b97088cee5/json HTTP/1.1" 200 457 http://localhost:None "GET /v1.46/exec/444ae1d466401307daca7c48d1523832eaf76c71b68b47b9c1fd96b97088cee5/json HTTP/1.1" 200 457 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/42b14be78843dec728c860f7b32e5a9f425b16eea867a827c6eb2c753540bfff/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/42b14be78843dec728c860f7b32e5a9f425b16eea867a827c6eb2c753540bfff/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/42b14be78843dec728c860f7b32e5a9f425b16eea867a827c6eb2c753540bfff/json HTTP/1.1" 200 457 http://localhost:None "GET /v1.46/exec/42b14be78843dec728c860f7b32e5a9f425b16eea867a827c6eb2c753540bfff/json HTTP/1.1" 200 457 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Executing query DROP DATABASE IF EXISTS replicated SYNC on replica1 Executing query DROP DATABASE IF EXISTS replicated SYNC on replica1 run container_id:roottests3latencylog-gw5-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/total'] run container_id:roottests3latencylog-gw5-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/total'] Command:[docker exec roottests3latencylog-gw5-resolver-1 curl -s http://resolver:8080/total] Command:[docker exec roottests3latencylog-gw5-resolver-1 curl -s http://resolver:8080/total] Executing query INSERT INTO postgres_database.postgresql_replica_4 SELECT number, 4 from numbers(50) on instance Executing query INSERT INTO postgres_database.postgresql_replica_4 SELECT number, 4 from numbers(50) on instance Stdout:1 Stdout:1 run container_id:roottests3latencylog-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'grep -a "Failed to make request to.*resolver:8080.*Timeout: connect timed out" /var/log/clickhouse-server/clickhouse-server.log | wc -l'] run container_id:roottests3latencylog-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'grep -a "Failed to make request to.*resolver:8080.*Timeout: connect timed out" /var/log/clickhouse-server/clickhouse-server.log | wc -l'] Command:[docker exec roottests3latencylog-gw5-node-1 bash -c grep -a "Failed to make request to.*resolver:8080.*Timeout: connect timed out" /var/log/clickhouse-server/clickhouse-server.log | wc -l] Command:[docker exec roottests3latencylog-gw5-node-1 bash -c grep -a "Failed to make request to.*resolver:8080.*Timeout: connect timed out" /var/log/clickhouse-server/clickhouse-server.log | wc -l] Stdout:0 Stdout:0 Latency log before - ([0, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0], [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]) Latency log before - ([0, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0], [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]) Connect times before - [(100, 0), (1000, 1), (10000, 1), (100000, 1), (200000, 1), (300000, 1), (500000, 1), (1000000, 1), (1500000, 1), (4294967295, 1)] Connect times before - [(100, 0), (1000, 1), (10000, 1), (100000, 1), (200000, 1), (300000, 1), (500000, 1), (1000000, 1), (1500000, 1), (4294967295, 1)] Connection timed out requests count before - 0 Connection timed out requests count before - 0 Resolver requests count before - 1 Resolver requests count before - 1 Executing query INSERT INTO s3_latency_log_test VALUES (1, 'Hello') on node Executing query INSERT INTO s3_latency_log_test VALUES (1, 'Hello') on node Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query DROP DATABASE IF EXISTS replicated SYNC on replica2 Executing query DROP DATABASE IF EXISTS replicated SYNC on replica2 Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query select 20 on distributed Executing query select 20 on distributed Executing query DROP DATABASE IF EXISTS replicated SYNC on replica3 Executing query DROP DATABASE IF EXISTS replicated SYNC on replica3 Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE TABLE sometable_insert (date Date, id UInt32, value Int32) ENGINE = MergeTree() ORDER BY id; on node1 Executing query CREATE TABLE sometable_insert (date Date, id UInt32, value Int32) ENGINE = MergeTree() ORDER BY id; on node1 Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance [gw7] PASSED test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null Executing query DROP DATABASE IF EXISTS replicated2 SYNC on replica1 Executing query DROP DATABASE IF EXISTS replicated2 SYNC on replica1 Executing query INSERT INTO sometable_insert VALUES (toDate('2010-01-10'), 1, 1) on node1 Executing query INSERT INTO sometable_insert VALUES (toDate('2010-01-10'), 1, 1) on node1 Executing query DROP DATABASE IF EXISTS replicated2 SYNC on replica2 Executing query DROP DATABASE IF EXISTS replicated2 SYNC on replica2 Executing query INSERT INTO postgres_database.postgresql_replica_0 SELECT 50 + number, 0 from numbers(1000) on instance Executing query INSERT INTO postgres_database.postgresql_replica_0 SELECT 50 + number, 0 from numbers(1000) on instance Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Executing query DROP DATABASE IF EXISTS replicated2 SYNC on replica3 Executing query DROP DATABASE IF EXISTS replicated2 SYNC on replica3 Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query CREATE TABLE sometable_insert (date Date, id UInt32, value Int32) ENGINE = MergeTree() ORDER BY id; on node2 Executing query CREATE TABLE sometable_insert (date Date, id UInt32, value Int32) ENGINE = MergeTree() ORDER BY id; on node2 Executing query INSERT INTO postgres_database.postgresql_replica_1 SELECT 50 + number, 1 from numbers(1000) on instance Executing query INSERT INTO postgres_database.postgresql_replica_1 SELECT 50 + number, 1 from numbers(1000) on instance Executing query CREATE DATABASE replicated2 ENGINE = Replicated('/clickhouse/databases/replicated2', 'default', 'replica1') on replica1 Executing query CREATE DATABASE replicated2 ENGINE = Replicated('/clickhouse/databases/replicated2', 'default', 'replica1') on replica1 Executing query INSERT INTO sometable_insert VALUES (toDate('2010-01-10'), 1, 1) on node2 Executing query INSERT INTO sometable_insert VALUES (toDate('2010-01-10'), 1, 1) on node2 Executing query INSERT INTO postgres_database.postgresql_replica_2 SELECT 50 + number, 2 from numbers(1000) on instance Executing query INSERT INTO postgres_database.postgresql_replica_2 SELECT 50 + number, 2 from numbers(1000) on instance Executing query select name, create_query from system.resources order by all on node Executing query select name, create_query from system.resources order by all on node Executing query CREATE DATABASE replicated2 ENGINE = Replicated('/clickhouse/databases/replicated2', 'default', 'replica2') on replica2 Executing query CREATE DATABASE replicated2 ENGINE = Replicated('/clickhouse/databases/replicated2', 'default', 'replica2') on replica2 Executing query CREATE TABLE proxy_insert (date Date, id UInt32, value Int32) ENGINE = Distributed(test_cluster, default, sometable_insert, toUInt64(date)); on distributed Executing query CREATE TABLE proxy_insert (date Date, id UInt32, value Int32) ENGINE = Distributed(test_cluster, default, sometable_insert, toUInt64(date)); on distributed Executing query select name, create_query from system.resources order by all on node2 Executing query select name, create_query from system.resources order by all on node2 Executing query INSERT INTO postgres_database.postgresql_replica_3 SELECT 50 + number, 3 from numbers(1000) on instance Executing query INSERT INTO postgres_database.postgresql_replica_3 SELECT 50 + number, 3 from numbers(1000) on instance Executing query CREATE DATABASE replicated2 ENGINE = Replicated('/clickhouse/databases/replicated2', 'default', 'replica3') on replica3 Executing query CREATE DATABASE replicated2 ENGINE = Replicated('/clickhouse/databases/replicated2', 'default', 'replica3') on replica3 Executing query ALTER USER shard SETTINGS max_memory_usage = 50000000 MIN 11111111 MAX 99999999 on node1 Executing query ALTER USER shard SETTINGS max_memory_usage = 50000000 MIN 11111111 MAX 99999999 on node1 Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node Executing query CREATE TABLE replicated2.example_s3_engine_table (name String, value UInt32) ENGINE = S3('https://clickhouse-public-datasets.s3.amazonaws.com/my-test-bucket-768/test-data.csv.gz', 'CSV', 'gzip') SETTINGS input_format_with_names_use_header = 0 on replica1 Executing query CREATE TABLE replicated2.example_s3_engine_table (name String, value UInt32) ENGINE = S3('https://clickhouse-public-datasets.s3.amazonaws.com/my-test-bucket-768/test-data.csv.gz', 'CSV', 'gzip') SETTINGS input_format_with_names_use_header = 0 on replica1 Executing query INSERT INTO postgres_database.postgresql_replica_4 SELECT 50 + number, 4 from numbers(1000) on instance Executing query INSERT INTO postgres_database.postgresql_replica_4 SELECT 50 + number, 4 from numbers(1000) on instance Executing query ALTER USER shard SETTINGS max_memory_usage = 50000000 MIN 11111111 MAX 99999999 on node2 Executing query ALTER USER shard SETTINGS max_memory_usage = 50000000 MIN 11111111 MAX 99999999 on node2 Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 Executing query INSERT INTO proxy_insert VALUES (toDate('2020-02-20'), 2, 2) on distributed Executing query INSERT INTO proxy_insert VALUES (toDate('2020-02-20'), 2, 2) on distributed Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query CREATE TABLE replicated2.mysql_schema_inference_engine ENGINE=MySQL('mysql80:3306', 'clickhouse', 'inference_table', 'root', 'clickhouse') on replica1 Executing query CREATE TABLE replicated2.mysql_schema_inference_engine ENGINE=MySQL('mysql80:3306', 'clickhouse', 'inference_table', 'root', 'clickhouse') on replica1 Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/72fcfe1e77117f73b4547fe0d445b55d4bc34483ead18559beca3514edfbc96b/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/72fcfe1e77117f73b4547fe0d445b55d4bc34483ead18559beca3514edfbc96b/start HTTP/1.1" 101 0 Executing query INSERT INTO proxy_insert VALUES (toDate('2020-02-21'), 2, 2) on distributed Executing query INSERT INTO proxy_insert VALUES (toDate('2020-02-21'), 2, 2) on distributed http://localhost:None "GET /v1.46/exec/72fcfe1e77117f73b4547fe0d445b55d4bc34483ead18559beca3514edfbc96b/json HTTP/1.1" 200 461 http://localhost:None "GET /v1.46/exec/72fcfe1e77117f73b4547fe0d445b55d4bc34483ead18559beca3514edfbc96b/json HTTP/1.1" 200 461 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/1017b95ee4a7470e1c486d4ebb141415c917ef73656a5b943cb55d86ec6ec084/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/1017b95ee4a7470e1c486d4ebb141415c917ef73656a5b943cb55d86ec6ec084/start HTTP/1.1" 101 0 Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance http://localhost:None "GET /v1.46/exec/1017b95ee4a7470e1c486d4ebb141415c917ef73656a5b943cb55d86ec6ec084/json HTTP/1.1" 200 461 http://localhost:None "GET /v1.46/exec/1017b95ee4a7470e1c486d4ebb141415c917ef73656a5b943cb55d86ec6ec084/json HTTP/1.1" 200 461 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): Executing query create workload all; on node Executing query create workload all; on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster2' and host_name='node_1' on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster2' and host_name='node_1' on node Executing query CREATE TABLE replicated2.mysql_schema_inference_function AS mysql('mysql80:3306', 'clickhouse', 'inference_table', 'root', 'clickhouse') on replica1 Executing query CREATE TABLE replicated2.mysql_schema_inference_function AS mysql('mysql80:3306', 'clickhouse', 'inference_table', 'root', 'clickhouse') on replica1 Executing query create workload X in all settings priority = 0; on node Executing query create workload X in all settings priority = 0; on node Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Executing query SYSTEM FLUSH DISTRIBUTED proxy_insert on distributed Executing query SYSTEM FLUSH DISTRIBUTED proxy_insert on distributed run container_id:roottestreloadclustersconfig-gw8-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo '\n\n \n \n \n true\n \n node_1\n 9000\n \n \n node_2\n 9000\n \n \n \n \n \n true\n \n node_1\n 9000\n \n \n node_2\n 9000\n \n \n \n \n \n true\n \n node_1\n 9000\n \n \n \n \n\n' > /etc/clickhouse-server/config.d/remote_servers.xml"] run container_id:roottestreloadclustersconfig-gw8-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo '\n\n \n \n \n true\n \n node_1\n 9000\n \n \n node_2\n 9000\n \n \n \n \n \n true\n \n node_1\n 9000\n \n \n node_2\n 9000\n \n \n \n \n \n true\n \n node_1\n 9000\n \n \n \n \n\n' > /etc/clickhouse-server/config.d/remote_servers.xml"] Command:[docker exec roottestreloadclustersconfig-gw8-node-1 bash -c echo ' true node_1 9000 node_2 9000 true node_1 9000 node_2 9000 true node_1 9000 ' > /etc/clickhouse-server/config.d/remote_servers.xml] Command:[docker exec roottestreloadclustersconfig-gw8-node-1 bash -c echo ' true node_1 9000 node_2 9000 true node_1 9000 node_2 9000 true node_1 9000 ' > /etc/clickhouse-server/config.d/remote_servers.xml] Executing query SYSTEM RELOAD CONFIG on node Executing query SYSTEM RELOAD CONFIG on node Executing query create workload Y in all settings priority = 1; on node Executing query create workload Y in all settings priority = 1; on node Executing query SELECT COUNT() FROM proxy_insert on distributed Executing query SELECT COUNT() FROM proxy_insert on distributed Executing query CREATE TABLE replicated2.merge_tree (id UInt64, b String) ORDER BY id on replica1 Executing query CREATE TABLE replicated2.merge_tree (id UInt64, b String) ORDER BY id on replica1 Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query create workload A1 in X settings priority = -1; on node Executing query create workload A1 in X settings priority = -1; on node Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance [gw2] PASSED test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps -C clickhouse] Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 740 ? 00:00:03 clickhouse Stdout: 740 ? 00:00:03 clickhouse run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c pkill clickhouse] Executing query create workload B1 in X settings priority = 1; on node Executing query create workload B1 in X settings priority = 1; on node run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query INSERT INTO replicated2.merge_tree VALUES (100, 'abc') on replica1 Executing query INSERT INTO replicated2.merge_tree VALUES (100, 'abc') on replica1 Executing query ALTER TABLE simple2 FETCH PARTITION '2020-08-27' FROM 'zookeeper2:/clickhouse/tables/0/simple'; on node Executing query ALTER TABLE simple2 FETCH PARTITION '2020-08-27' FROM 'zookeeper2:/clickhouse/tables/0/simple'; on node Stdout:740 Stdout:740 Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance Executing query create workload C1 in Y settings priority = -1; on node Executing query create workload C1 in Y settings priority = -1; on node Executing query DESCRIBE TABLE replicated2.mysql_schema_inference_engine on replica1 Executing query DESCRIBE TABLE replicated2.mysql_schema_inference_engine on replica1 Executing query SELECT id FROM simple2 on node Executing query SELECT id FROM simple2 on node Executing query create workload D1 in Y settings priority = 1; on node Executing query create workload D1 in Y settings priority = 1; on node Executing query select * from `postgres_database`.`postgresql_replica_1` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_1` order by key; on instance Executing query DESCRIBE TABLE replicated2.mysql_schema_inference_function on replica1 Executing query DESCRIBE TABLE replicated2.mysql_schema_inference_function on replica1 Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/.env --project-name roottestreloadauxiliaryzookeepers-gw6 --file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/.env --project-name roottestreloadauxiliaryzookeepers-gw6 --file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop --timeout 20] [gw6] PASSED test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers Executing query create workload A2 in X settings priority = -1; on node Executing query create workload A2 in X settings priority = -1; on node Executing query select * from `test_database`.`postgresql_replica_1` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_1` order by key; on instance Executing query SELECT id FROM mysql('mysql80:3306', 'clickhouse', 'inference_table', 'root', 'clickhouse') on replica1 Executing query SELECT id FROM mysql('mysql80:3306', 'clickhouse', 'inference_table', 'root', 'clickhouse') on replica1 Executing query create workload B2 in X settings priority = 1; on node Executing query create workload B2 in X settings priority = 1; on node Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query SELECT id FROM replicated2.mysql_schema_inference_engine on replica1 Executing query SELECT id FROM replicated2.mysql_schema_inference_engine on replica1 Stdout:740 Stdout:740 Executing query create workload C2 in Y settings priority = -1; on node Executing query create workload C2 in Y settings priority = -1; on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance Executing query create workload D2 in Y settings priority = 1; on node Executing query create workload D2 in Y settings priority = 1; on node Executing query SELECT id FROM replicated2.mysql_schema_inference_function on replica1 Executing query SELECT id FROM replicated2.mysql_schema_inference_function on replica1 Executing query select * from `postgres_database`.`postgresql_replica_2` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_2` order by key; on instance Executing query drop workload A1; on node Executing query drop workload A1; on node Executing query SELECT id FROM replicated2.merge_tree on replica1 Executing query SELECT id FROM replicated2.merge_tree on replica1 Executing query select * from `test_database`.`postgresql_replica_2` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_2` order by key; on instance Executing query drop workload A2; on node Executing query drop workload A2; on node Executing query CREATE DICTIONARY replicated2.dict1 (id INT, data String) PRIMARY KEY id SOURCE(MYSQL(HOST 'mysql80' PORT 3306 USER 'root' PASSWORD 'clickhouse' DB 'clickhouse' TABLE 'inference_table'))LAYOUT(FLAT()) LIFETIME(MIN 0 MAX 10) on replica1 Executing query CREATE DICTIONARY replicated2.dict1 (id INT, data String) PRIMARY KEY id SOURCE(MYSQL(HOST 'mysql80' PORT 3306 USER 'root' PASSWORD 'clickhouse' DB 'clickhouse' TABLE 'inference_table'))LAYOUT(FLAT()) LIFETIME(MIN 0 MAX 10) on replica1 Executing query drop workload B1; on node Executing query drop workload B1; on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-distributed-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestsettingsconstraintsdistributed-gw2-distributed-1/exec HTTP/1.1" 201 74 Executing query drop workload B2; on node Executing query drop workload B2; on node http://localhost:None "POST /v1.46/exec/8617a4a92201763909579620b950fa8ba56a8fa0a87c02cff07dd0b5b6458ff6/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/8617a4a92201763909579620b950fa8ba56a8fa0a87c02cff07dd0b5b6458ff6/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/8617a4a92201763909579620b950fa8ba56a8fa0a87c02cff07dd0b5b6458ff6/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/8617a4a92201763909579620b950fa8ba56a8fa0a87c02cff07dd0b5b6458ff6/json HTTP/1.1" 200 586 Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster2' and host_name='node_1' on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster2' and host_name='node_1' on node Executing query CREATE DICTIONARY replicated2.dict2 (name String, value UInt32) PRIMARY KEY value SOURCE(CLICKHOUSE(HOST '127.0.0.2' PORT 9000 USER 'default' PASSWORD '' DB 'replicated2' TABLE 'example_s3_engine_table'))LAYOUT(FLAT()) LIFETIME(MIN 0 MAX 10) on replica1 Executing query CREATE DICTIONARY replicated2.dict2 (name String, value UInt32) PRIMARY KEY value SOURCE(CLICKHOUSE(HOST '127.0.0.2' PORT 9000 USER 'default' PASSWORD '' DB 'replicated2' TABLE 'example_s3_engine_table'))LAYOUT(FLAT()) LIFETIME(MIN 0 MAX 10) on replica1 Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Executing query drop workload C1; on node Executing query drop workload C1; on node Executing query drop workload C2; on node Executing query drop workload C2; on node Executing query SELECT * FROM system.clusters WHERE cluster='test_cluster3' on node Executing query SELECT * FROM system.clusters WHERE cluster='test_cluster3' on node Executing query select * from `postgres_database`.`postgresql_replica_3` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_3` order by key; on instance Executing query CREATE DICTIONARY replicated2.dict3 (name String, value UInt32) PRIMARY KEY value SOURCE(CLICKHOUSE(USER 'default' PASSWORD '' DB 'replicated2' TABLE 'example_s3_engine_table'))LAYOUT(FLAT()) LIFETIME(MIN 0 MAX 10) on replica1 Executing query CREATE DICTIONARY replicated2.dict3 (name String, value UInt32) PRIMARY KEY value SOURCE(CLICKHOUSE(USER 'default' PASSWORD '' DB 'replicated2' TABLE 'example_s3_engine_table'))LAYOUT(FLAT()) LIFETIME(MIN 0 MAX 10) on replica1 Executing query drop workload D1; on node Executing query drop workload D1; on node Executing query select * from `test_database`.`postgresql_replica_3` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_3` order by key; on instance Executing query drop workload D2; on node Executing query drop workload D2; on node Executing query SYSTEM SYNC DATABASE REPLICA replicated2 on replica2 Executing query SYSTEM SYNC DATABASE REPLICA replicated2 on replica2 Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:1508 Stdout:1508 Clickhouse process running. Clickhouse process running. run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestsettingsconstraintsdistributed-gw2-distributed-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestsettingsconstraintsdistributed-gw2-distributed-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query create workload Z in all; on node Executing query create workload Z in all; on node Executing query BACKUP DATABASE replicated2 TO Disk('backups', '2/') on replica2 Executing query BACKUP DATABASE replicated2 TO Disk('backups', '2/') on replica2 Stdout:1508 Stdout:1508 Executing query select 20 on distributed Executing query select 20 on distributed Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance Executing query create workload A1 in Z settings priority = -1; on node Executing query create workload A1 in Z settings priority = -1; on node Executing query DROP DICTIONARY IF EXISTS replicated2.dict3 SYNC on replica2 Executing query DROP DICTIONARY IF EXISTS replicated2.dict3 SYNC on replica2 Executing query create workload A2 in Z settings priority = -1; on node Executing query create workload A2 in Z settings priority = -1; on node Executing query select * from `postgres_database`.`postgresql_replica_4` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_4` order by key; on instance Executing query DROP DICTIONARY IF EXISTS replicated2.dict2 SYNC on replica2 Executing query DROP DICTIONARY IF EXISTS replicated2.dict2 SYNC on replica2 Executing query create workload A3 in Z settings priority = -1; on node Executing query create workload A3 in Z settings priority = -1; on node Executing query select 20 on distributed Executing query select 20 on distributed Executing query select * from `test_database`.`postgresql_replica_4` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_4` order by key; on instance Executing query create workload B1 in Z settings priority = 1; on node Executing query create workload B1 in Z settings priority = 1; on node Executing query DROP DICTIONARY IF EXISTS replicated2.dict1 SYNC on replica2 Executing query DROP DICTIONARY IF EXISTS replicated2.dict1 SYNC on replica2 Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query create workload B2 in Z settings priority = 1; on node Executing query create workload B2 in Z settings priority = 1; on node Executing query select 20 on distributed Executing query select 20 on distributed Executing query DROP TABLE replicated2.example_s3_engine_table on replica2 Executing query DROP TABLE replicated2.example_s3_engine_table on replica2 Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query create workload B3 in Z settings priority = 1; on node Executing query create workload B3 in Z settings priority = 1; on node Executing query create workload C1 in X settings priority = -1; on node Executing query create workload C1 in X settings priority = -1; on node Executing query DROP TABLE replicated2.mysql_schema_inference_engine on replica2 Executing query DROP TABLE replicated2.mysql_schema_inference_engine on replica2 Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Executing query select 20 on distributed Executing query select 20 on distributed Executing query create workload C2 in X settings priority = -1; on node Executing query create workload C2 in X settings priority = -1; on node Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Stderr: Container roottestreloadauxiliaryzookeepers-gw6-node-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw6-node-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw6-node-1 Stopped Stderr: Container roottestreloadauxiliaryzookeepers-gw6-node-1 Stopped Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo1-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo1-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo2-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo2-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo3-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo3-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo2-1 Stopped Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo2-1 Stopped Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo1-1 Stopped Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo1-1 Stopped Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo3-1 Stopped Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo3-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Executing query CREATE TABLE sometable_select (date Date, id UInt32, value Int32) ENGINE = MergeTree() ORDER BY id; on node1 Executing query CREATE TABLE sometable_select (date Date, id UInt32, value Int32) ENGINE = MergeTree() ORDER BY id; on node1 Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/.env --project-name roottestreloadauxiliaryzookeepers-gw6 --file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/.env --project-name roottestreloadauxiliaryzookeepers-gw6 --file /ClickHouse/tests/integration/test_reload_auxiliary_zookeepers/_instances-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml down --volumes] Executing query DROP TABLE replicated2.mysql_schema_inference_function on replica2 Executing query DROP TABLE replicated2.mysql_schema_inference_function on replica2 Executing query create workload C3 in X settings priority = -1; on node Executing query create workload C3 in X settings priority = -1; on node Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query INSERT INTO sometable_select VALUES (toDate('2010-01-10'), 1, 1) on node1 Executing query create workload D1 in X settings priority = 1; on node Executing query create workload D1 in X settings priority = 1; on node Executing query INSERT INTO sometable_select VALUES (toDate('2010-01-10'), 1, 1) on node1 Executing query SYSTEM SYNC DATABASE REPLICA replicated2 on replica3 Executing query SYSTEM SYNC DATABASE REPLICA replicated2 on replica3 Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance Executing query create workload D2 in X settings priority = 1; on node Executing query create workload D2 in X settings priority = 1; on node Executing query CREATE TABLE sometable_select (date Date, id UInt32, value Int32) ENGINE = MergeTree() ORDER BY id; on node2 Executing query CREATE TABLE sometable_select (date Date, id UInt32, value Int32) ENGINE = MergeTree() ORDER BY id; on node2 Executing query EXISTS replicated2.mysql_schema_inference_engine on replica3 Executing query EXISTS replicated2.mysql_schema_inference_engine on replica3 Stderr: Container roottestreloadauxiliaryzookeepers-gw6-node-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw6-node-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw6-node-1 Stopped Stderr: Container roottestreloadauxiliaryzookeepers-gw6-node-1 Stopped Stderr: Container roottestreloadauxiliaryzookeepers-gw6-node-1 Removing Stderr: Container roottestreloadauxiliaryzookeepers-gw6-node-1 Removing Stderr: Container roottestreloadauxiliaryzookeepers-gw6-node-1 Removed Stderr: Container roottestreloadauxiliaryzookeepers-gw6-node-1 Removed Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo1-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo1-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo2-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo2-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo3-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo3-1 Stopping Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo1-1 Stopped Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo1-1 Stopped Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo1-1 Removing Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo1-1 Removing Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo2-1 Stopped Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo2-1 Stopped Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo2-1 Removing Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo2-1 Removing Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo3-1 Stopped Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo3-1 Stopped Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo3-1 Removing Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo3-1 Removing Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo3-1 Removed Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo3-1 Removed Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo1-1 Removed Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo1-1 Removed Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo2-1 Removed Stderr: Container roottestreloadauxiliaryzookeepers-gw6-zoo2-1 Removed Stderr: Network roottestreloadauxiliaryzookeepers-gw6_default Removing Stderr: Network roottestreloadauxiliaryzookeepers-gw6_default Removing Stderr: Network roottestreloadauxiliaryzookeepers-gw6_default Removed Stderr: Network roottestreloadauxiliaryzookeepers-gw6_default Removed Cleanup called Cleanup called Docker networks for project roottestreloadauxiliaryzookeepers-gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreloadauxiliaryzookeepers-gw6 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreloadauxiliaryzookeepers-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreloadauxiliaryzookeepers-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreloadauxiliaryzookeepers-gw6 are DRIVER VOLUME NAME Docker volumes for project roottestreloadauxiliaryzookeepers-gw6 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreloadauxiliaryzookeepers-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreloadauxiliaryzookeepers-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Executing query create workload D3 in X settings priority = 1; on node Executing query create workload D3 in X settings priority = 1; on node Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreloadauxiliaryzookeepers-gw6 No running containers for project: roottestreloadauxiliaryzookeepers-gw6 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Executing query select * from `postgres_database`.`postgresql_replica_1` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_1` order by key; on instance Stdout:14 Stdout:14 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 14 Volumes pruned: 14 Running tests in /ClickHouse/tests/integration/test_remote_prewhere/test.py Running tests in /ClickHouse/tests/integration/test_remote_prewhere/test.py Cluster start called. is_up=False Cluster start called. is_up=False test_remote_prewhere/test.py::test_remote Executing query INSERT INTO sometable_select VALUES (toDate('2010-01-10'), 1, 1) on node2 Executing query INSERT INTO sometable_select VALUES (toDate('2010-01-10'), 1, 1) on node2 Docker networks for project roottestremoteprewhere-gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestremoteprewhere-gw6 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestremoteprewhere-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestremoteprewhere-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestremoteprewhere-gw6 are DRIVER VOLUME NAME Docker volumes for project roottestremoteprewhere-gw6 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottestremoteprewhere-gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestremoteprewhere-gw6 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestremoteprewhere-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestremoteprewhere-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestremoteprewhere-gw6 are DRIVER VOLUME NAME Docker volumes for project roottestremoteprewhere-gw6 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestremoteprewhere-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestremoteprewhere-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Executing query EXISTS replicated2.mysql_schema_inference_function on replica3 Executing query EXISTS replicated2.mysql_schema_inference_function on replica3 Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestremoteprewhere-gw6 No running containers for project: roottestremoteprewhere-gw6 Trying to prune unused networks... Trying to prune unused networks... Executing query drop workload A1; on node Executing query drop workload A1; on node Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:14 Stdout:14 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 14 Volumes pruned: 14 Setup directory for instance: node1 Setup directory for instance: node1 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files [] to /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node1/configs/config.d Copy custom test config files [] to /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node1/configs/config.d Setup database dir /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node1/database Setup database dir /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node1/database Setup logs dir /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node1/logs Setup logs dir /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node1/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Setup directory for instance: node2 Setup directory for instance: node2 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files [] to /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node2/configs/config.d Copy custom test config files [] to /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node2/configs/config.d Setup database dir /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node2/database Setup database dir /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node2/database Setup logs dir /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node2/logs Setup logs dir /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node2/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw'} stored in /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw'} stored in /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/.env --project-name roottestremoteprewhere-gw6 --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node2/docker-compose.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/.env --project-name roottestremoteprewhere-gw6 --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node2/docker-compose.yml pull] Executing query select * from `test_database`.`postgresql_replica_1` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_1` order by key; on instance Executing query CREATE TABLE proxy_select (date Date, id UInt32, value Int32) ENGINE = Distributed(test_cluster, default, sometable_select, toUInt64(date)); on distributed Executing query CREATE TABLE proxy_select (date Date, id UInt32, value Int32) ENGINE = Distributed(test_cluster, default, sometable_select, toUInt64(date)); on distributed Executing query drop workload B1; on node Executing query drop workload B1; on node Executing query RESTORE DATABASE replicated2 FROM Disk('backups', '2/') SETTINGS allow_different_database_def=1, allow_different_table_def=1 SETTINGS restore_replace_external_engines_to_null=1, restore_replace_external_table_functions_to_null=1, restore_replace_external_dictionary_source_to_null=1 on replica3 Executing query RESTORE DATABASE replicated2 FROM Disk('backups', '2/') SETTINGS allow_different_database_def=1, allow_different_table_def=1 SETTINGS restore_replace_external_engines_to_null=1, restore_replace_external_table_functions_to_null=1, restore_replace_external_dictionary_source_to_null=1 on replica3 Executing query CREATE USER normal DEFAULT ROLE admin SETTINGS max_memory_usage = 80000000 on distributed Executing query CREATE USER normal DEFAULT ROLE admin SETTINGS max_memory_usage = 80000000 on distributed Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Executing query drop workload C1; on node Executing query drop workload C1; on node Executing query CREATE USER wasteful DEFAULT ROLE admin SETTINGS max_memory_usage = 2000000000 on distributed Executing query CREATE USER wasteful DEFAULT ROLE admin SETTINGS max_memory_usage = 2000000000 on distributed http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/1de04909e38ea727e1a3607b3e728d6038cee160522a618b7c1827f897848c1b/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/1de04909e38ea727e1a3607b3e728d6038cee160522a618b7c1827f897848c1b/start HTTP/1.1" 101 0 Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance http://localhost:None "GET /v1.46/exec/1de04909e38ea727e1a3607b3e728d6038cee160522a618b7c1827f897848c1b/json HTTP/1.1" 200 457 http://localhost:None "GET /v1.46/exec/1de04909e38ea727e1a3607b3e728d6038cee160522a618b7c1827f897848c1b/json HTTP/1.1" 200 457 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/81301ad5923bb5d2e3f9f3b8e982b2a4f6a31771e34fb119d531ebb7ce09bfa3/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/81301ad5923bb5d2e3f9f3b8e982b2a4f6a31771e34fb119d531ebb7ce09bfa3/start HTTP/1.1" 101 0 Executing query CREATE USER readonly DEFAULT ROLE admin SETTINGS readonly = 1 on distributed Executing query CREATE USER readonly DEFAULT ROLE admin SETTINGS readonly = 1 on distributed http://localhost:None "GET /v1.46/exec/81301ad5923bb5d2e3f9f3b8e982b2a4f6a31771e34fb119d531ebb7ce09bfa3/json HTTP/1.1" 200 457 http://localhost:None "GET /v1.46/exec/81301ad5923bb5d2e3f9f3b8e982b2a4f6a31771e34fb119d531ebb7ce09bfa3/json HTTP/1.1" 200 457 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Executing query SYSTEM SYNC DATABASE REPLICA replicated2 on replica1 Executing query SYSTEM SYNC DATABASE REPLICA replicated2 on replica1 Executing query select * from `postgres_database`.`postgresql_replica_2` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_2` order by key; on instance Executing query ALTER USER shard SETTINGS max_memory_usage = 50000000 MIN 11111111 MAX 99999999 on node1 Executing query ALTER USER shard SETTINGS max_memory_usage = 50000000 MIN 11111111 MAX 99999999 on node1 Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query SELECT engine FROM system.tables where database = 'replicated2' and name = 'example_s3_engine_table' on replica1 Executing query SELECT engine FROM system.tables where database = 'replicated2' and name = 'example_s3_engine_table' on replica1 Executing query select * from `test_database`.`postgresql_replica_2` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_2` order by key; on instance Executing query ALTER USER shard SETTINGS readonly = 1 on node2 Executing query ALTER USER shard SETTINGS readonly = 1 on node2 Executing query SELECT count(), sum(id) FROM replicated2.mysql_schema_inference_engine on replica1 Executing query SELECT count(), sum(id) FROM replicated2.mysql_schema_inference_engine on replica1 Executing query SELECT COUNT() FROM proxy_select on distributed Executing query SELECT COUNT() FROM proxy_select on distributed Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Executing query SELECT count(), sum(id) FROM replicated2.mysql_schema_inference_function on replica1 Executing query SELECT count(), sum(id) FROM replicated2.mysql_schema_inference_function on replica1 Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Executing query SELECT COUNT() FROM proxy_select on distributed Executing query SELECT COUNT() FROM proxy_select on distributed Executing query SELECT count(), sum(id) FROM replicated2.merge_tree on replica1 Executing query SELECT count(), sum(id) FROM replicated2.merge_tree on replica1 Executing query select * from `postgres_database`.`postgresql_replica_3` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_3` order by key; on instance Executing query SELECT COUNT() FROM proxy_select on distributed Executing query SELECT COUNT() FROM proxy_select on distributed Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Executing query SELECT engine FROM system.tables where database = 'replicated2' and name like '%mysql%' on replica1 Executing query SELECT engine FROM system.tables where database = 'replicated2' and name like '%mysql%' on replica1 Executing query select * from `test_database`.`postgresql_replica_3` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_3` order by key; on instance Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query SELECT COUNT() FROM proxy_select on distributed Executing query SELECT COUNT() FROM proxy_select on distributed Executing query SELECT engine FROM system.tables where database = 'replicated2' and name like '%merge_tree%' on replica1 Executing query SELECT engine FROM system.tables where database = 'replicated2' and name like '%merge_tree%' on replica1 Executing query SYSTEM FLUSH LOGS on node Executing query SYSTEM FLUSH LOGS on node Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query SHOW CREATE replicated2.dict1 on replica1 Executing query SHOW CREATE replicated2.dict1 on replica1 Executing query SELECT COUNT() FROM proxy_select on distributed Executing query SELECT COUNT() FROM proxy_select on distributed Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Executing query SHOW CREATE replicated2.dict1 on replica1 Executing query SHOW CREATE replicated2.dict1 on replica1 Executing query SELECT COUNT() FROM proxy_select on distributed Executing query SELECT COUNT() FROM proxy_select on distributed Executing query select * from `postgres_database`.`postgresql_replica_4` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_4` order by key; on instance Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query SHOW CREATE replicated2.dict3 on replica1 Executing query SHOW CREATE replicated2.dict3 on replica1 Executing query SELECT COUNT() FROM remote('node{1,2}', 'default', 'sometable_select') on distributed Executing query SELECT COUNT() FROM remote('node{1,2}', 'default', 'sometable_select') on distributed Executing query select * from `test_database`.`postgresql_replica_4` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_4` order by key; on instance Executing query SELECT (LatencyEvent_S3ConnectMicroseconds, LatencyEvent_S3FirstByteWriteAttempt1Microseconds, LatencyEvent_S3FirstByteWriteAttempt2Microseconds, LatencyEvent_S3FirstByteWriteAttemptNMicroseconds) FROM system.latency_log ORDER BY event_time_microseconds DESC LIMIT 1 on node Executing query SELECT (LatencyEvent_S3ConnectMicroseconds, LatencyEvent_S3FirstByteWriteAttempt1Microseconds, LatencyEvent_S3FirstByteWriteAttempt2Microseconds, LatencyEvent_S3FirstByteWriteAttemptNMicroseconds) FROM system.latency_log ORDER BY event_time_microseconds DESC LIMIT 1 on node Executing query DROP DATABASE IF EXISTS replicated2 SYNC on replica1 Executing query DROP DATABASE IF EXISTS replicated2 SYNC on replica1 Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT COUNT() FROM remote('node{1,2}', 'default', 'sometable_select') on distributed Executing query SELECT COUNT() FROM remote('node{1,2}', 'default', 'sometable_select') on distributed Executing query WITH (SELECT LatencyEvent_DiskS3ConnectMicroseconds FROM system.latency_buckets) AS buckets SELECT format('[{}]', arrayStringConcat(arrayMap((t, c) -> format('({},{})', toString(t), c), buckets, LatencyEvent_DiskS3ConnectMicroseconds), ',')) FROM system.latency_log ORDER BY event_time_microseconds DESC LIMIT 1 on node Executing query WITH (SELECT LatencyEvent_DiskS3ConnectMicroseconds FROM system.latency_buckets) AS buckets SELECT format('[{}]', arrayStringConcat(arrayMap((t, c) -> format('({},{})', toString(t), c), buckets, LatencyEvent_DiskS3ConnectMicroseconds), ',')) FROM system.latency_log ORDER BY event_time_microseconds DESC LIMIT 1 on node Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Executing query DROP DATABASE IF EXISTS replicated2 SYNC on replica2 Executing query DROP DATABASE IF EXISTS replicated2 SYNC on replica2 Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query DROP DATABASE IF EXISTS replicated2 SYNC on replica3 Executing query DROP DATABASE IF EXISTS replicated2 SYNC on replica3 Executing query SELECT COUNT() FROM remote('node{1,2}', 'default', 'sometable_select') on distributed Executing query SELECT COUNT() FROM remote('node{1,2}', 'default', 'sometable_select') on distributed Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 run container_id:roottests3latencylog-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'grep -a "Failed to make request to.*resolver:8080.*Timeout: connect timed out" /var/log/clickhouse-server/clickhouse-server.log | wc -l'] run container_id:roottests3latencylog-gw5-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'grep -a "Failed to make request to.*resolver:8080.*Timeout: connect timed out" /var/log/clickhouse-server/clickhouse-server.log | wc -l'] Command:[docker exec roottests3latencylog-gw5-node-1 bash -c grep -a "Failed to make request to.*resolver:8080.*Timeout: connect timed out" /var/log/clickhouse-server/clickhouse-server.log | wc -l] Command:[docker exec roottests3latencylog-gw5-node-1 bash -c grep -a "Failed to make request to.*resolver:8080.*Timeout: connect timed out" /var/log/clickhouse-server/clickhouse-server.log | wc -l] Stdout:13 Stdout:13 run container_id:roottests3latencylog-gw5-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/total'] run container_id:roottests3latencylog-gw5-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://resolver:8080/total'] Command:[docker exec roottests3latencylog-gw5-resolver-1 curl -s http://resolver:8080/total] Command:[docker exec roottests3latencylog-gw5-resolver-1 curl -s http://resolver:8080/total] Stdout:14 Stdout:14 Latency log after - ([2, 16, 16, 16, 16, 16, 16, 29, 29, 29], [11, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12], [4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4], [8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8]) Latency log after - ([2, 16, 16, 16, 16, 16, 16, 29, 29, 29], [11, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12], [4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4], [8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8]) Connect times after - [(100, 2), (1000, 16), (10000, 16), (100000, 16), (200000, 16), (300000, 16), (500000, 16), (1000000, 29), (1500000, 29), (4294967295, 29)] Connect times after - [(100, 2), (1000, 16), (10000, 16), (100000, 16), (200000, 16), (300000, 16), (500000, 16), (1000000, 29), (1500000, 29), (4294967295, 29)] Connection timed out requests count after - 13 Connection timed out requests count after - 13 Resolver requests count after - 13 Resolver requests count after - 13 Below second connect time cnt - 15, other connect time cnt - 28 Below second connect time cnt - 15, other connect time cnt - 28 Executing query DROP TABLE s3_latency_log_test on node Executing query DROP TABLE s3_latency_log_test on node Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Executing query SELECT hostName() as host, name, value FROM shard_settings WHERE name = 'max_memory_usage' OR name = 'readonly' ORDER BY host, name, value on distributed Executing query SELECT hostName() as host, name, value FROM shard_settings WHERE name = 'max_memory_usage' OR name = 'readonly' ORDER BY host, name, value on distributed Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/.env --project-name roottests3latencylog-gw5 --file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/.env --project-name roottests3latencylog-gw5 --file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] [gw5] PASSED test_s3_latency_log/test.py::test_latency_log Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Command:[docker compose --env-file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/.env --project-name roottestrestoreexternalengines-gw7 --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_mysql_8_0.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica2/docker-compose.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica3/docker-compose.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/.env --project-name roottestrestoreexternalengines-gw7 --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_mysql_8_0.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica2/docker-compose.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica3/docker-compose.yml stop --timeout 20] [gw7] PASSED test_restore_external_engines/test.py::test_restore_table_null Executing query SELECT hostName() as host, name, value FROM shard_settings WHERE name = 'max_memory_usage' OR name = 'readonly' ORDER BY host, name, value on distributed Executing query SELECT hostName() as host, name, value FROM shard_settings WHERE name = 'max_memory_usage' OR name = 'readonly' ORDER BY host, name, value on distributed Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance Executing query SELECT hostName() as host, name, value FROM shard_settings WHERE name = 'max_memory_usage' OR name = 'readonly' ORDER BY host, name, value on distributed Executing query SELECT hostName() as host, name, value FROM shard_settings WHERE name = 'max_memory_usage' OR name = 'readonly' ORDER BY host, name, value on distributed Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query select * from `postgres_database`.`postgresql_replica_1` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_1` order by key; on instance Executing query SELECT hostName() as host, name, value FROM shard_settings WHERE name = 'max_memory_usage' OR name = 'readonly' ORDER BY host, name, value on distributed Executing query SELECT hostName() as host, name, value FROM shard_settings WHERE name = 'max_memory_usage' OR name = 'readonly' ORDER BY host, name, value on distributed Executing query select * from `test_database`.`postgresql_replica_1` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_1` order by key; on instance Executing query SELECT hostName() as host, name, value FROM shard_settings WHERE name = 'max_memory_usage' OR name = 'readonly' ORDER BY host, name, value on distributed Executing query SELECT hostName() as host, name, value FROM shard_settings WHERE name = 'max_memory_usage' OR name = 'readonly' ORDER BY host, name, value on distributed Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Executing query SELECT hostName() as host, name, value FROM shard_settings WHERE name = 'max_memory_usage' OR name = 'readonly' ORDER BY host, name, value on distributed Executing query SELECT hostName() as host, name, value FROM shard_settings WHERE name = 'max_memory_usage' OR name = 'readonly' ORDER BY host, name, value on distributed Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Executing query select * from `postgres_database`.`postgresql_replica_2` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_2` order by key; on instance Executing query SELECT hostName() as host, name, value FROM shard_settings WHERE name = 'max_memory_usage' OR name = 'readonly' ORDER BY host, name, value on distributed Executing query SELECT hostName() as host, name, value FROM shard_settings WHERE name = 'max_memory_usage' OR name = 'readonly' ORDER BY host, name, value on distributed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/.env --project-name roottestreplicatedmergetreereplicateddbttl-gw3 --file /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances-0-gw3/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query select * from `test_database`.`postgresql_replica_2` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_2` order by key; on instance Command:[docker compose --env-file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/.env --project-name roottestsettingsconstraintsdistributed-gw2 --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/docker-compose.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/.env --project-name roottestsettingsconstraintsdistributed-gw2 --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/docker-compose.yml stop --timeout 20] [gw2] PASSED test_settings_constraints_distributed/test.py::test_select_clamps_settings run container_id:roottestreloadclustersconfig-gw8-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo '\n\n \n \n \n true\n \n node_1\n 9000\n \n \n node_2\n 9000\n \n \n \n \n \n true\n \n node_1\n 9000\n \n \n node_2\n 9000\n \n \n \n \n\n' > /etc/clickhouse-server/config.d/remote_servers.xml"] run container_id:roottestreloadclustersconfig-gw8-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo '\n\n \n \n \n true\n \n node_1\n 9000\n \n \n node_2\n 9000\n \n \n \n \n \n true\n \n node_1\n 9000\n \n \n node_2\n 9000\n \n \n \n \n\n' > /etc/clickhouse-server/config.d/remote_servers.xml"] Command:[docker exec roottestreloadclustersconfig-gw8-node-1 bash -c echo ' true node_1 9000 node_2 9000 true node_1 9000 node_2 9000 ' > /etc/clickhouse-server/config.d/remote_servers.xml] Command:[docker exec roottestreloadclustersconfig-gw8-node-1 bash -c echo ' true node_1 9000 node_2 9000 true node_1 9000 node_2 9000 ' > /etc/clickhouse-server/config.d/remote_servers.xml] Executing query SYSTEM RELOAD CONFIG on node Executing query SYSTEM RELOAD CONFIG on node Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Removed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-node1-1 Removed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Removed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-resolver-1 Removed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Removed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo3-1 Removed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Removed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo1-1 Removed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Removed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-zoo2-1 Removed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Removed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-minio1-1 Removed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Stopping Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Stopped Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Removing Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Removed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy2-1 Removed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Removed Stderr: Container roottestreplicatedmergetreereplicateddbttl-gw3-proxy1-1 Removed Stderr: Volume roottestreplicatedmergetreereplicateddbttl-gw3_data1-1 Removing Stderr: Volume roottestreplicatedmergetreereplicateddbttl-gw3_data1-1 Removing Stderr: Network roottestreplicatedmergetreereplicateddbttl-gw3_default Removing Stderr: Network roottestreplicatedmergetreereplicateddbttl-gw3_default Removing Stderr: Volume roottestreplicatedmergetreereplicateddbttl-gw3_data1-1 Removed Stderr: Volume roottestreplicatedmergetreereplicateddbttl-gw3_data1-1 Removed Stderr: Network roottestreplicatedmergetreereplicateddbttl-gw3_default Removed Stderr: Network roottestreplicatedmergetreereplicateddbttl-gw3_default Removed Cleanup called Cleanup called Docker networks for project roottestreplicatedmergetreereplicateddbttl-gw3 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedmergetreereplicateddbttl-gw3 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicatedmergetreereplicateddbttl-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedmergetreereplicateddbttl-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicatedmergetreereplicateddbttl-gw3 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedmergetreereplicateddbttl-gw3 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreplicatedmergetreereplicateddbttl-gw3-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreplicatedmergetreereplicateddbttl-gw3-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicatedmergetreereplicateddbttl-gw3 No running containers for project: roottestreplicatedmergetreereplicateddbttl-gw3 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:12 Stdout:12 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 12 Volumes pruned: 12 test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach Running tests in /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/test.py Running tests in /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottestreplicatedparsezkmetadata-gw3 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedparsezkmetadata-gw3 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicatedparsezkmetadata-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedparsezkmetadata-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicatedparsezkmetadata-gw3 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedparsezkmetadata-gw3 are DRIVER VOLUME NAME Cleanup called Cleanup called Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Docker networks for project roottestreplicatedparsezkmetadata-gw3 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedparsezkmetadata-gw3 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicatedparsezkmetadata-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedparsezkmetadata-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES [gw8] PASSED test_reload_clusters_config/test.py::test_add_cluster Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node test_reload_clusters_config/test.py::test_delete_cluster Docker volumes for project roottestreplicatedparsezkmetadata-gw3 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedparsezkmetadata-gw3 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreplicatedparsezkmetadata-gw3-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreplicatedparsezkmetadata-gw3-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicatedparsezkmetadata-gw3 No running containers for project: roottestreplicatedparsezkmetadata-gw3 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:12 Stdout:12 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 12 Volumes pruned: 12 Setup directory for instance: node Setup directory for instance: node Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files [] to /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/node/configs/config.d Copy custom test config files [] to /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/node/configs/config.d Setup database dir /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/node/database Setup database dir /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/node/database Setup logs dir /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/node/logs Setup logs dir /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/node/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/.env --project-name roottestreplicatedparsezkmetadata-gw3 --file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/.env --project-name roottestreplicatedparsezkmetadata-gw3 --file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml pull] Stderr: Container roottests3storageconfproxy-gw4-node-1 Stopping Stderr: Container roottests3storageconfproxy-gw4-node-1 Stopping Stderr: Container roottests3storageconfproxy-gw4-resolver-1 Stopping Stderr: Container roottests3storageconfproxy-gw4-resolver-1 Stopping Stderr: Container roottests3storageconfproxy-gw4-node-1 Stopped Stderr: Container roottests3storageconfproxy-gw4-node-1 Stopped Stderr: Container roottests3storageconfproxy-gw4-minio1-1 Stopping Stderr: Container roottests3storageconfproxy-gw4-minio1-1 Stopping Stderr: Container roottests3storageconfproxy-gw4-minio1-1 Stopped Stderr: Container roottests3storageconfproxy-gw4-minio1-1 Stopped Stderr: Container roottests3storageconfproxy-gw4-resolver-1 Stopped Stderr: Container roottests3storageconfproxy-gw4-resolver-1 Stopped Stderr: Container roottests3storageconfproxy-gw4-proxy1-1 Stopping Stderr: Container roottests3storageconfproxy-gw4-proxy1-1 Stopping Stderr: Container roottests3storageconfproxy-gw4-proxy2-1 Stopping Stderr: Container roottests3storageconfproxy-gw4-proxy2-1 Stopping Stderr: Container roottests3storageconfproxy-gw4-proxy2-1 Stopped Stderr: Container roottests3storageconfproxy-gw4-proxy2-1 Stopped Stderr: Container roottests3storageconfproxy-gw4-proxy1-1 Stopped Stderr: Container roottests3storageconfproxy-gw4-proxy1-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/.env --project-name roottests3storageconfproxy-gw4 --file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/.env --project-name roottests3storageconfproxy-gw4 --file /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Executing query select * from `postgres_database`.`postgresql_replica_3` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_3` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_3` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_3` order by key; on instance Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Stderr: Container roottests3storageconfproxy-gw4-node-1 Stopping Stderr: Container roottests3storageconfproxy-gw4-node-1 Stopping Stderr: Container roottests3storageconfproxy-gw4-resolver-1 Stopping Stderr: Container roottests3storageconfproxy-gw4-resolver-1 Stopping Stderr: Container roottests3storageconfproxy-gw4-node-1 Stopped Stderr: Container roottests3storageconfproxy-gw4-node-1 Stopped Stderr: Container roottests3storageconfproxy-gw4-node-1 Removing Stderr: Container roottests3storageconfproxy-gw4-node-1 Removing Stderr: Container roottests3storageconfproxy-gw4-resolver-1 Stopped Stderr: Container roottests3storageconfproxy-gw4-resolver-1 Stopped Stderr: Container roottests3storageconfproxy-gw4-resolver-1 Removing Stderr: Container roottests3storageconfproxy-gw4-resolver-1 Removing Stderr: Container roottests3storageconfproxy-gw4-node-1 Removed Stderr: Container roottests3storageconfproxy-gw4-node-1 Removed Stderr: Container roottests3storageconfproxy-gw4-minio1-1 Stopping Stderr: Container roottests3storageconfproxy-gw4-minio1-1 Stopping Stderr: Container roottests3storageconfproxy-gw4-minio1-1 Stopped Stderr: Container roottests3storageconfproxy-gw4-minio1-1 Stopped Stderr: Container roottests3storageconfproxy-gw4-minio1-1 Removing Stderr: Container roottests3storageconfproxy-gw4-minio1-1 Removing Stderr: Container roottests3storageconfproxy-gw4-resolver-1 Removed Stderr: Container roottests3storageconfproxy-gw4-resolver-1 Removed Stderr: Container roottests3storageconfproxy-gw4-minio1-1 Removed Stderr: Container roottests3storageconfproxy-gw4-minio1-1 Removed Stderr: Container roottests3storageconfproxy-gw4-proxy2-1 Stopping Stderr: Container roottests3storageconfproxy-gw4-proxy2-1 Stopping Stderr: Container roottests3storageconfproxy-gw4-proxy1-1 Stopping Stderr: Container roottests3storageconfproxy-gw4-proxy1-1 Stopping Stderr: Container roottests3storageconfproxy-gw4-proxy2-1 Stopped Stderr: Container roottests3storageconfproxy-gw4-proxy2-1 Stopped Stderr: Container roottests3storageconfproxy-gw4-proxy2-1 Removing Stderr: Container roottests3storageconfproxy-gw4-proxy2-1 Removing Stderr: Container roottests3storageconfproxy-gw4-proxy1-1 Stopped Stderr: Container roottests3storageconfproxy-gw4-proxy1-1 Stopped Stderr: Container roottests3storageconfproxy-gw4-proxy1-1 Removing Stderr: Container roottests3storageconfproxy-gw4-proxy1-1 Removing Stderr: Container roottests3storageconfproxy-gw4-proxy1-1 Removed Stderr: Container roottests3storageconfproxy-gw4-proxy1-1 Removed Stderr: Container roottests3storageconfproxy-gw4-proxy2-1 Removed Stderr: Container roottests3storageconfproxy-gw4-proxy2-1 Removed Stderr: Volume roottests3storageconfproxy-gw4_data1-1 Removing Stderr: Volume roottests3storageconfproxy-gw4_data1-1 Removing Stderr: Network roottests3storageconfproxy-gw4_default Removing Stderr: Network roottests3storageconfproxy-gw4_default Removing Stderr: Volume roottests3storageconfproxy-gw4_data1-1 Removed Stderr: Volume roottests3storageconfproxy-gw4_data1-1 Removed Stderr: Network roottests3storageconfproxy-gw4_default Removed Stderr: Network roottests3storageconfproxy-gw4_default Removed Cleanup called Cleanup called Docker networks for project roottests3storageconfproxy-gw4 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3storageconfproxy-gw4 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3storageconfproxy-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3storageconfproxy-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3storageconfproxy-gw4 are DRIVER VOLUME NAME Docker volumes for project roottests3storageconfproxy-gw4 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3storageconfproxy-gw4-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3storageconfproxy-gw4-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3storageconfproxy-gw4 No running containers for project: roottests3storageconfproxy-gw4 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:10 Stdout:10 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 10 Volumes pruned: 10 test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV HOSTNAME 3624a24af23d ENV HOSTNAME 3624a24af23d ENV SHLVL 0 ENV SHLVL 0 ENV HOME /root ENV HOME /root ENV OLDPWD / ENV OLDPWD / ENV DOCKER_HELPER_TAG 5dc43a6382f0 ENV DOCKER_HELPER_TAG 5dc43a6382f0 ENV PYTHONUNBUFFERED 1 ENV PYTHONUNBUFFERED 1 ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e ENV UBSAN_OPTIONS print_stacktrace=1 ENV UBSAN_OPTIONS print_stacktrace=1 ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots test_postgresql_replica_database_engine_1/test.py::test_virtual_columns test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_remote_prewhere/test.py::test_remote test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16]' 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12]' test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replicated_user_defined_functions/test.py::test_create_and_drop 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1]' 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0]' test_replicated_user_defined_functions/test.py::test_create_and_replace test_replicated_user_defined_functions/test.py::test_drop_if_exists test_replicated_user_defined_functions/test.py::test_reload_zookeeper test_replicated_user_defined_functions/test.py::test_replication test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation test_replicated_user_defined_functions/test.py::test_server_restart test_replicated_user_defined_functions/test.py::test_start_without_zookeeper test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_s3_imds/test_session_token.py::test_credentials_from_metadata test_s3_imds/test_simple.py::test_credentials_from_metadata test_s3_latency_log/test.py::test_latency_log test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver]' test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy test_scheduler/test.py::test_create_workload test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_resource_any_disk test_scheduler/test.py::test_resource_read_and_write test_scheduler/test.py::test_s3_disk test_scheduler/test.py::test_s3_resource_request_granularity test_scheduler/test.py::test_throw_on_unknown_workload test_scheduler/test.py::test_workload_entity_keeper_storage test_scheduler/test.py::test_workload_hierarchy_changes test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings -vvv -ss ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots test_postgresql_replica_database_engine_1/test.py::test_virtual_columns test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_remote_prewhere/test.py::test_remote test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16]' 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12]' test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replicated_user_defined_functions/test.py::test_create_and_drop 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1]' 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0]' test_replicated_user_defined_functions/test.py::test_create_and_replace test_replicated_user_defined_functions/test.py::test_drop_if_exists test_replicated_user_defined_functions/test.py::test_reload_zookeeper test_replicated_user_defined_functions/test.py::test_replication test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation test_replicated_user_defined_functions/test.py::test_server_restart test_replicated_user_defined_functions/test.py::test_start_without_zookeeper test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_s3_imds/test_session_token.py::test_credentials_from_metadata test_s3_imds/test_simple.py::test_credentials_from_metadata test_s3_latency_log/test.py::test_latency_log test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver]' test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy test_scheduler/test.py::test_create_workload test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_resource_any_disk test_scheduler/test.py::test_resource_read_and_write test_scheduler/test.py::test_s3_disk test_scheduler/test.py::test_s3_resource_request_granularity test_scheduler/test.py::test_throw_on_unknown_workload test_scheduler/test.py::test_workload_entity_keeper_storage test_scheduler/test.py::test_workload_hierarchy_changes test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings -vvv -ss ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge ENV COMPOSE_HTTP_TIMEOUT 600 ENV COMPOSE_HTTP_TIMEOUT 600 ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_CHANNEL stable ENV DOCKER_CHANNEL stable ENV DOCKER_CLIENT_TIMEOUT 300 ENV DOCKER_CLIENT_TIMEOUT 300 ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV PWD /ClickHouse/tests/integration ENV PWD /ClickHouse/tests/integration ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV TZ Etc/UTC ENV TZ Etc/UTC ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV DOCKER_BASE_TAG 8b2301119731 ENV DOCKER_BASE_TAG 8b2301119731 ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV LC_CTYPE C.UTF-8 ENV LC_CTYPE C.UTF-8 ENV INTEGRATION_TESTS_RUN_ID 0 ENV INTEGRATION_TESTS_RUN_ID 0 ENV WORKER_FREE_PORTS 30200 30201 30202 30203 30204 30205 30206 30207 30208 30209 30210 30211 30212 30213 30214 30215 30216 30217 30218 30219 30220 30221 30222 30223 30224 30225 30226 30227 30228 30229 30230 30231 30232 30233 30234 30235 30236 30237 30238 30239 30240 30241 30242 30243 30244 30245 30246 30247 30248 30249 ENV WORKER_FREE_PORTS 30200 30201 30202 30203 30204 30205 30206 30207 30208 30209 30210 30211 30212 30213 30214 30215 30216 30217 30218 30219 30220 30221 30222 30223 30224 30225 30226 30227 30228 30229 30230 30231 30232 30233 30234 30235 30236 30237 30238 30239 30240 30241 30242 30243 30244 30245 30246 30247 30248 30249 ENV PYTEST_XDIST_TESTRUNUID c5ba503209524253afe87e95762d6d1b ENV PYTEST_XDIST_TESTRUNUID c5ba503209524253afe87e95762d6d1b ENV PYTEST_XDIST_WORKER gw4 ENV PYTEST_XDIST_WORKER gw4 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV SSL_CERT_FILE /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/minio/certs/public.crt ENV SSL_CERT_FILE /ClickHouse/tests/integration/test_s3_storage_conf_proxy/_instances-0-gw4/minio/certs/public.crt ENV PYTEST_CURRENT_TEST test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart (setup) ENV PYTEST_CURRENT_TEST test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart (setup) CLUSTER INIT base_config_dir:/clickhouse-config CLUSTER INIT base_config_dir:/clickhouse-config clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Cluster name: project_name:roottestrestartwithunavailableazure-gw4. Added instance name:node tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/.env', '--project-name', 'roottestrestartwithunavailableazure-gw4', '--file', '/ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottestrestartwithunavailableazure-gw4. Added instance name:node tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/.env', '--project-name', 'roottestrestartwithunavailableazure-gw4', '--file', '/ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Running tests in /ClickHouse/tests/integration/test_restart_with_unavailable_azure/test.py Running tests in /ClickHouse/tests/integration/test_restart_with_unavailable_azure/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottestrestartwithunavailableazure-gw4 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestrestartwithunavailableazure-gw4 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestrestartwithunavailableazure-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestrestartwithunavailableazure-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestrestartwithunavailableazure-gw4 are DRIVER VOLUME NAME Docker volumes for project roottestrestartwithunavailableazure-gw4 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottestrestartwithunavailableazure-gw4 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestrestartwithunavailableazure-gw4 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestrestartwithunavailableazure-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestrestartwithunavailableazure-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestrestartwithunavailableazure-gw4 are DRIVER VOLUME NAME Docker volumes for project roottestrestartwithunavailableazure-gw4 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestrestartwithunavailableazure-gw4-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestrestartwithunavailableazure-gw4-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestrestartwithunavailableazure-gw4 No running containers for project: roottestrestartwithunavailableazure-gw4 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:10 Stdout:10 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 10 Volumes pruned: 10 Setup directory for instance: node Setup directory for instance: node Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_restart_with_unavailable_azure/configs/disable_async_loader.xml'] to /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/node/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_restart_with_unavailable_azure/configs/disable_async_loader.xml'] to /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/node/configs/config.d Setup database dir /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/node/database Setup database dir /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/node/database Setup logs dir /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/node/logs Setup logs dir /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/node/logs Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/resolver', 'RESOLVER_LOGS_FS': 'bind', 'AZURITE_PORT': '30200', 'AZURITE_STORAGE_ACCOUNT_URL': 'http://azurite1:30200/devstoreaccount1', 'AZURITE_CONNECTION_STRING': 'DefaultEndpointsProtocol=http;AccountName=devstoreaccount1;AccountKey=Eby8vdM02xNOcqFlqUwJPLlmEtlCDXJ1OUzFT50uSRZ6IFsuFq2UVErCz4I6tq/K1SZFPTOtr/KBHBeksoGMGw==;BlobEndpoint=http://azurite1:30200/devstoreaccount1;'} stored in /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/resolver', 'RESOLVER_LOGS_FS': 'bind', 'AZURITE_PORT': '30200', 'AZURITE_STORAGE_ACCOUNT_URL': 'http://azurite1:30200/devstoreaccount1', 'AZURITE_CONNECTION_STRING': 'DefaultEndpointsProtocol=http;AccountName=devstoreaccount1;AccountKey=Eby8vdM02xNOcqFlqUwJPLlmEtlCDXJ1OUzFT50uSRZ6IFsuFq2UVErCz4I6tq/K1SZFPTOtr/KBHBeksoGMGw==;BlobEndpoint=http://azurite1:30200/devstoreaccount1;'} stored in /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/.env --project-name roottestrestartwithunavailableazure-gw4 --file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/.env --project-name roottestrestartwithunavailableazure-gw4 --file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml pull] Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Stderr: Container roottestrestoreexternalengines-gw7-replica1-1 Stopping Stderr: Container roottestrestoreexternalengines-gw7-replica1-1 Stopping Stderr: Container roottestrestoreexternalengines-gw7-replica2-1 Stopping Stderr: Container roottestrestoreexternalengines-gw7-replica2-1 Stopping Stderr: Container roottestrestoreexternalengines-gw7-replica3-1 Stopping Stderr: Container roottestrestoreexternalengines-gw7-replica3-1 Stopping Stderr: Container roottestrestoreexternalengines-gw7-replica3-1 Stopped Stderr: Container roottestrestoreexternalengines-gw7-replica3-1 Stopped Stderr: Container roottestrestoreexternalengines-gw7-replica2-1 Stopped Stderr: Container roottestrestoreexternalengines-gw7-replica2-1 Stopped Stderr: Container roottestrestoreexternalengines-gw7-replica1-1 Stopped Stderr: Container roottestrestoreexternalengines-gw7-replica1-1 Stopped Stderr: Container roottestrestoreexternalengines-gw7-zoo2-1 Stopping Stderr: Container roottestrestoreexternalengines-gw7-zoo2-1 Stopping Stderr: Container roottestrestoreexternalengines-gw7-mysql80-1 Stopping Stderr: Container roottestrestoreexternalengines-gw7-mysql80-1 Stopping Stderr: Container roottestrestoreexternalengines-gw7-zoo3-1 Stopping Stderr: Container roottestrestoreexternalengines-gw7-zoo3-1 Stopping Stderr: Container roottestrestoreexternalengines-gw7-zoo1-1 Stopping Stderr: Container roottestrestoreexternalengines-gw7-zoo1-1 Stopping Stderr: Container roottestrestoreexternalengines-gw7-zoo3-1 Stopped Stderr: Container roottestrestoreexternalengines-gw7-zoo3-1 Stopped Stderr: Container roottestrestoreexternalengines-gw7-zoo2-1 Stopped Stderr: Container roottestrestoreexternalengines-gw7-zoo2-1 Stopped Stderr: Container roottestrestoreexternalengines-gw7-zoo1-1 Stopped Stderr: Container roottestrestoreexternalengines-gw7-zoo1-1 Stopped Stderr: Container roottestrestoreexternalengines-gw7-mysql80-1 Stopped Stderr: Container roottestrestoreexternalengines-gw7-mysql80-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica3/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica3/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica3/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica3/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/.env --project-name roottestrestoreexternalengines-gw7 --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_mysql_8_0.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica2/docker-compose.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica3/docker-compose.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/.env --project-name roottestrestoreexternalengines-gw7 --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_mysql_8_0.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica2/docker-compose.yml --file /ClickHouse/tests/integration/test_restore_external_engines/_instances-0-gw7/replica3/docker-compose.yml down --volumes] Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance Executing query select * from `postgres_database`.`postgresql_replica_4` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_4` order by key; on instance Stderr: Container roottestrestoreexternalengines-gw7-replica2-1 Stopping Stderr: Container roottestrestoreexternalengines-gw7-replica2-1 Stopping Stderr: Container roottestrestoreexternalengines-gw7-replica3-1 Stopping Stderr: Container roottestrestoreexternalengines-gw7-replica3-1 Stopping Stderr: Container roottestrestoreexternalengines-gw7-replica1-1 Stopping Stderr: Container roottestrestoreexternalengines-gw7-replica1-1 Stopping Stderr: Container roottestrestoreexternalengines-gw7-replica3-1 Stopped Stderr: Container roottestrestoreexternalengines-gw7-replica3-1 Stopped Stderr: Container roottestrestoreexternalengines-gw7-replica3-1 Removing Stderr: Container roottestrestoreexternalengines-gw7-replica3-1 Removing Stderr: Container roottestrestoreexternalengines-gw7-replica2-1 Stopped Stderr: Container roottestrestoreexternalengines-gw7-replica2-1 Stopped Stderr: Container roottestrestoreexternalengines-gw7-replica2-1 Removing Stderr: Container roottestrestoreexternalengines-gw7-replica2-1 Removing Stderr: Container roottestrestoreexternalengines-gw7-replica1-1 Stopped Stderr: Container roottestrestoreexternalengines-gw7-replica1-1 Stopped Stderr: Container roottestrestoreexternalengines-gw7-replica1-1 Removing Stderr: Container roottestrestoreexternalengines-gw7-replica1-1 Removing Stderr: Container roottestrestoreexternalengines-gw7-replica1-1 Removed Stderr: Container roottestrestoreexternalengines-gw7-replica1-1 Removed Stderr: Container roottestrestoreexternalengines-gw7-replica2-1 Removed Stderr: Container roottestrestoreexternalengines-gw7-replica2-1 Removed Stderr: Container roottestrestoreexternalengines-gw7-replica3-1 Removed Stderr: Container roottestrestoreexternalengines-gw7-replica3-1 Removed Stderr: Container roottestrestoreexternalengines-gw7-zoo1-1 Stopping Stderr: Container roottestrestoreexternalengines-gw7-zoo1-1 Stopping Stderr: Container roottestrestoreexternalengines-gw7-zoo2-1 Stopping Stderr: Container roottestrestoreexternalengines-gw7-zoo2-1 Stopping Stderr: Container roottestrestoreexternalengines-gw7-mysql80-1 Stopping Stderr: Container roottestrestoreexternalengines-gw7-mysql80-1 Stopping Stderr: Container roottestrestoreexternalengines-gw7-zoo3-1 Stopping Stderr: Container roottestrestoreexternalengines-gw7-zoo3-1 Stopping Stderr: Container roottestrestoreexternalengines-gw7-zoo1-1 Stopped Stderr: Container roottestrestoreexternalengines-gw7-zoo1-1 Stopped Stderr: Container roottestrestoreexternalengines-gw7-zoo1-1 Removing Stderr: Container roottestrestoreexternalengines-gw7-zoo1-1 Removing Stderr: Container roottestrestoreexternalengines-gw7-mysql80-1 Stopped Stderr: Container roottestrestoreexternalengines-gw7-mysql80-1 Stopped Stderr: Container roottestrestoreexternalengines-gw7-mysql80-1 Removing Stderr: Container roottestrestoreexternalengines-gw7-mysql80-1 Removing Stderr: Container roottestrestoreexternalengines-gw7-zoo2-1 Stopped Stderr: Container roottestrestoreexternalengines-gw7-zoo2-1 Stopped Stderr: Container roottestrestoreexternalengines-gw7-zoo2-1 Removing Stderr: Container roottestrestoreexternalengines-gw7-zoo2-1 Removing Stderr: Container roottestrestoreexternalengines-gw7-zoo3-1 Stopped Stderr: Container roottestrestoreexternalengines-gw7-zoo3-1 Stopped Stderr: Container roottestrestoreexternalengines-gw7-zoo3-1 Removing Stderr: Container roottestrestoreexternalengines-gw7-zoo3-1 Removing Stderr: Container roottestrestoreexternalengines-gw7-zoo1-1 Removed Stderr: Container roottestrestoreexternalengines-gw7-zoo1-1 Removed Stderr: Container roottestrestoreexternalengines-gw7-zoo2-1 Removed Stderr: Container roottestrestoreexternalengines-gw7-zoo2-1 Removed Stderr: Container roottestrestoreexternalengines-gw7-zoo3-1 Removed Stderr: Container roottestrestoreexternalengines-gw7-zoo3-1 Removed Stderr: Container roottestrestoreexternalengines-gw7-mysql80-1 Removed Stderr: Container roottestrestoreexternalengines-gw7-mysql80-1 Removed Stderr: Network roottestrestoreexternalengines-gw7_default Removing Stderr: Network roottestrestoreexternalengines-gw7_default Removing Stderr: Network roottestrestoreexternalengines-gw7_default Removed Stderr: Network roottestrestoreexternalengines-gw7_default Removed Cleanup called Cleanup called Docker networks for project roottestrestoreexternalengines-gw7 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestrestoreexternalengines-gw7 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestrestoreexternalengines-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestrestoreexternalengines-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestrestoreexternalengines-gw7 are DRIVER VOLUME NAME Docker volumes for project roottestrestoreexternalengines-gw7 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestrestoreexternalengines-gw7-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestrestoreexternalengines-gw7-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestrestoreexternalengines-gw7 No running containers for project: roottestrestoreexternalengines-gw7 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:9 Stdout:9 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 9 Volumes pruned: 9 test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility Running tests in /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/test.py Running tests in /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottestreplicatedmergetreecompatibility-gw7 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedmergetreecompatibility-gw7 are NETWORK ID NAME DRIVER SCOPE Executing query select * from `test_database`.`postgresql_replica_4` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_4` order by key; on instance Docker containers for project roottestreplicatedmergetreecompatibility-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedmergetreecompatibility-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicatedmergetreecompatibility-gw7 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedmergetreecompatibility-gw7 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottestreplicatedmergetreecompatibility-gw7 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedmergetreecompatibility-gw7 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicatedmergetreecompatibility-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedmergetreecompatibility-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicatedmergetreecompatibility-gw7 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedmergetreecompatibility-gw7 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreplicatedmergetreecompatibility-gw7-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreplicatedmergetreecompatibility-gw7-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicatedmergetreecompatibility-gw7 No running containers for project: roottestreplicatedmergetreecompatibility-gw7 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:9 Stdout:9 Command:[docker volume prune -f] Command:[docker volume prune -f] Stderr: node1 Skipped - Image is already being pulled by node2 Stderr: node1 Skipped - Image is already being pulled by node2 Stderr: node2 Pulling Stderr: node2 Pulling Stderr: node2 Pulled Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 9 Volumes pruned: 9 Setup directory for instance: node1 Setup directory for instance: node1 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Stderr: node2 Pulled Create directory for common tests configuration Create directory for common tests configuration ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/.env --project-name roottestremoteprewhere-gw6 --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node2/docker-compose.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/.env --project-name roottestremoteprewhere-gw6 --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node2/docker-compose.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/.env --project-name roottestremoteprewhere-gw6 --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node2/docker-compose.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/.env --project-name roottestremoteprewhere-gw6 --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node2/docker-compose.yml up -d --no-recreate] Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files [] to /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node1/configs/config.d Copy custom test config files [] to /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node1/configs/config.d Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node1/database Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node1/database Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node1/logs Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node1/logs Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Setup directory for instance: node2 Setup directory for instance: node2 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files [] to /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node2/configs/config.d Copy custom test config files [] to /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node2/configs/config.d Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node2/database Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node2/database Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node2/logs Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node2/logs Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/.env --project-name roottestreplicatedmergetreecompatibility-gw7 --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node2/docker-compose.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/.env --project-name roottestreplicatedmergetreecompatibility-gw7 --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node2/docker-compose.yml pull] [gw0] PASSED test_postgresql_replica_database_engine_1/test.py::test_replicating_dml Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Stderr: zoo2 Skipped - Image is already being pulled by zoo1 Stderr: zoo2 Skipped - Image is already being pulled by zoo1 Stderr: node Skipped - Image is already being pulled by zoo1 Stderr: node Skipped - Image is already being pulled by zoo1 Stderr: zoo3 Skipped - Image is already being pulled by zoo1 Stderr: zoo3 Skipped - Image is already being pulled by zoo1 Stderr: zoo1 Pulling Stderr: zoo1 Pulling Stderr: zoo1 Pulled Stderr: zoo1 Pulled Setup ZooKeeper Setup ZooKeeper Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper1/log', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper1/config', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper1/coordination', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper2/log', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper2/config', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper2/coordination', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper3/log', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper3/config', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper3/coordination'] Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper1/log', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper1/config', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper1/coordination', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper2/log', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper2/config', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper2/coordination', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper3/log', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper3/config', '/ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/keeper3/coordination'] Command:[docker compose --project-name roottestreplicatedparsezkmetadata-gw3 --env-file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Command:[docker compose --project-name roottestreplicatedparsezkmetadata-gw3 --env-file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Stopping Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Stopping Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Stopping Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Stopping Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Stopping Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Stopping Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Stopped Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Stopped Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Stopped Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Stopped Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Stopped Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/.env --project-name roottestsettingsconstraintsdistributed-gw2 --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/docker-compose.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/.env --project-name roottestsettingsconstraintsdistributed-gw2 --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_settings_constraints_distributed/_instances-0-gw2/distributed/docker-compose.yml down --volumes] Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Stderr: Network roottestremoteprewhere-gw6_default Creating Stderr: Network roottestremoteprewhere-gw6_default Creating Stderr: Network roottestremoteprewhere-gw6_default Created Stderr: Network roottestremoteprewhere-gw6_default Created Stderr: Container roottestremoteprewhere-gw6-node1-1 Creating Stderr: Container roottestremoteprewhere-gw6-node1-1 Creating Stderr: Container roottestremoteprewhere-gw6-node2-1 Creating Stderr: Container roottestremoteprewhere-gw6-node2-1 Creating Stderr: Container roottestremoteprewhere-gw6-node2-1 Created Stderr: Container roottestremoteprewhere-gw6-node2-1 Created Stderr: Container roottestremoteprewhere-gw6-node1-1 Created Stderr: Container roottestremoteprewhere-gw6-node1-1 Created Stderr: Container roottestremoteprewhere-gw6-node1-1 Starting Stderr: Container roottestremoteprewhere-gw6-node1-1 Starting Stderr: Container roottestremoteprewhere-gw6-node2-1 Starting Stderr: Container roottestremoteprewhere-gw6-node2-1 Starting Stderr: Container roottestremoteprewhere-gw6-node2-1 Started Stderr: Container roottestremoteprewhere-gw6-node2-1 Started Stderr: Container roottestremoteprewhere-gw6-node1-1 Started Stderr: Container roottestremoteprewhere-gw6-node1-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestremoteprewhere-gw6-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremoteprewhere-gw6-node1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestremoteprewhere-gw6-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremoteprewhere-gw6-node1-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node1, ip: 172.16.2.2... Waiting for ClickHouse start in node1, ip: 172.16.2.2... http://localhost:None "GET /v1.46/containers/roottestremoteprewhere-gw6-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremoteprewhere-gw6-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Stopping Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Stopping Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Stopping Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Stopping Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Stopping Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Stopping Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Stopped Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Stopped Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Removing Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Removing Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Stopped Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Stopped Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Removing Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Removing Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Stopped Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Stopped Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Removing Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Removing Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Removed Stderr: Container roottestsettingsconstraintsdistributed-gw2-node2-1 Removed Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Removed Stderr: Container roottestsettingsconstraintsdistributed-gw2-distributed-1 Removed Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Removed Stderr: Container roottestsettingsconstraintsdistributed-gw2-node1-1 Removed Stderr: Network roottestsettingsconstraintsdistributed-gw2_default Removing Stderr: Network roottestsettingsconstraintsdistributed-gw2_default Removing Stderr: Network roottestsettingsconstraintsdistributed-gw2_default Removed Stderr: Network roottestsettingsconstraintsdistributed-gw2_default Removed Cleanup called Cleanup called Docker networks for project roottestsettingsconstraintsdistributed-gw2 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestsettingsconstraintsdistributed-gw2 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestsettingsconstraintsdistributed-gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestsettingsconstraintsdistributed-gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None Docker volumes for project roottestsettingsconstraintsdistributed-gw2 are DRIVER VOLUME NAME Docker volumes for project roottestsettingsconstraintsdistributed-gw2 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestsettingsconstraintsdistributed-gw2-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestsettingsconstraintsdistributed-gw2-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestsettingsconstraintsdistributed-gw2 No running containers for project: roottestsettingsconstraintsdistributed-gw2 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:9 Stdout:9 Command:[docker volume prune -f] Command:[docker volume prune -f] http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 9 Volumes pruned: 9 http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None Stderr:time="2025-04-02T02:55:56Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:55:56Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestreplicatedparsezkmetadata-gw3_default Creating Stderr: Network roottestreplicatedparsezkmetadata-gw3_default Creating Stderr: Network roottestreplicatedparsezkmetadata-gw3_default Created Stderr: Network roottestreplicatedparsezkmetadata-gw3_default Created Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo1-1 Creating Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo1-1 Creating Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo2-1 Creating Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo2-1 Creating Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo3-1 Creating Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo3-1 Creating Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo1-1 Created Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo1-1 Created Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo3-1 Created Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo3-1 Created Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo2-1 Created Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo2-1 Created Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo1-1 Starting Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo1-1 Starting Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo2-1 Starting Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo2-1 Starting Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo3-1 Starting Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo3-1 Starting Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo1-1 Started Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo1-1 Started Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo3-1 Started Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo3-1 Started Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo2-1 Started Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo2-1 Started Stderr:time="2025-04-02T02:55:57Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:57Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:57Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:55:57Z" level=debug msg="otel error" error="" Wait ZooKeeper to start Wait ZooKeeper to start get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreplicatedparsezkmetadata-gw3-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedparsezkmetadata-gw3-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.3.3, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.3.3, port:2181, use_ssl:False Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished Executing query INSERT INTO `postgres_database`.postgresql_replica_0 SELECT number, number from numbers(100000) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_0 SELECT number, number from numbers(100000) on instance Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query select name, create_query from system.resources order by all on node Executing query select name, create_query from system.resources order by all on node http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None Executing query select name, create_query from system.resources order by all on node2 Executing query select name, create_query from system.resources order by all on node2 http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None Executing query INSERT INTO `postgres_database`.postgresql_replica_1 SELECT number, number from numbers(100000) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_1 SELECT number, number from numbers(100000) on instance http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/14e834cf040307d2b606c342338b4125e76ee9d42219f53dadeb71b16efa7f64/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/14e834cf040307d2b606c342338b4125e76ee9d42219f53dadeb71b16efa7f64/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/exec/14e834cf040307d2b606c342338b4125e76ee9d42219f53dadeb71b16efa7f64/json HTTP/1.1" 200 461 http://localhost:None "GET /v1.46/exec/14e834cf040307d2b606c342338b4125e76ee9d42219f53dadeb71b16efa7f64/json HTTP/1.1" 200 461 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/17753333321bf110487852e40deabb727062516eb972edc6f1fcaf954622d169/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/17753333321bf110487852e40deabb727062516eb972edc6f1fcaf954622d169/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/17753333321bf110487852e40deabb727062516eb972edc6f1fcaf954622d169/json HTTP/1.1" 200 461 http://localhost:None "GET /v1.46/exec/17753333321bf110487852e40deabb727062516eb972edc6f1fcaf954622d169/json HTTP/1.1" 200 461 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): Executing query drop workload D1; on node Executing query drop workload D1; on node http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None Executing query drop workload A2; on node Executing query drop workload A2; on node http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None Executing query drop workload B2; on node Executing query drop workload B2; on node http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/7ca7158e1278087a98fbc30243ef52849e0a9b99a3f89cff2dc8dcb402a0b229/json HTTP/1.1" 200 None ClickHouse node1 started ClickHouse node1 started get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestremoteprewhere-gw6-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremoteprewhere-gw6-node2-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestremoteprewhere-gw6-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremoteprewhere-gw6-node2-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node2, ip: 172.16.2.3... Waiting for ClickHouse start in node2, ip: 172.16.2.3... http://localhost:None "GET /v1.46/containers/roottestremoteprewhere-gw6-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremoteprewhere-gw6-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/67f5798662d2966595884adfa5c5e156c54336252749bd90664112140240e583/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/67f5798662d2966595884adfa5c5e156c54336252749bd90664112140240e583/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/67f5798662d2966595884adfa5c5e156c54336252749bd90664112140240e583/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/67f5798662d2966595884adfa5c5e156c54336252749bd90664112140240e583/json HTTP/1.1" 200 None ClickHouse node2 started ClickHouse node2 started Executing query CREATE TABLE test_table( APIKey UInt32, CustomAttributeId UInt64, ProfileIDHash UInt64, DeviceIDHash UInt64, Data String) ENGINE = SummingMergeTree() ORDER BY (APIKey, CustomAttributeId, ProfileIDHash, DeviceIDHash, intHash32(DeviceIDHash)) on node1 Executing query CREATE TABLE test_table( APIKey UInt32, CustomAttributeId UInt64, ProfileIDHash UInt64, DeviceIDHash UInt64, Data String) ENGINE = SummingMergeTree() ORDER BY (APIKey, CustomAttributeId, ProfileIDHash, DeviceIDHash, intHash32(DeviceIDHash)) on node1 Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query drop workload C2; on node Executing query drop workload C2; on node Executing query CREATE TABLE test_table( APIKey UInt32, CustomAttributeId UInt64, ProfileIDHash UInt64, DeviceIDHash UInt64, Data String) ENGINE = SummingMergeTree() ORDER BY (APIKey, CustomAttributeId, ProfileIDHash, DeviceIDHash, intHash32(DeviceIDHash)) on node2 Executing query CREATE TABLE test_table( APIKey UInt32, CustomAttributeId UInt64, ProfileIDHash UInt64, DeviceIDHash UInt64, Data String) ENGINE = SummingMergeTree() ORDER BY (APIKey, CustomAttributeId, ProfileIDHash, DeviceIDHash, intHash32(DeviceIDHash)) on node2 Executing query drop workload D2; on node Executing query drop workload D2; on node Executing query INSERT INTO `postgres_database`.postgresql_replica_2 SELECT number, number from numbers(100000) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_2 SELECT number, number from numbers(100000) on instance Executing query SELECT 1 FROM remote('node{1,2}', default.test_table) WHERE (APIKey = 137715) AND (CustomAttributeId IN (45, 66)) AND (ProfileIDHash != 0) LIMIT 1 on node1 Executing query SELECT 1 FROM remote('node{1,2}', default.test_table) WHERE (APIKey = 137715) AND (CustomAttributeId IN (45, 66)) AND (ProfileIDHash != 0) LIMIT 1 on node1 Executing query drop workload A3; on node Executing query drop workload A3; on node Executing query drop workload B3; on node Executing query drop workload B3; on node Command:[docker compose --env-file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/.env --project-name roottestremoteprewhere-gw6 --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node2/docker-compose.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/.env --project-name roottestremoteprewhere-gw6 --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node2/docker-compose.yml stop --timeout 20] [gw6] PASSED test_remote_prewhere/test.py::test_remote Executing query drop workload C3; on node Executing query drop workload C3; on node Executing query drop workload D3; on node Executing query drop workload D3; on node Executing query drop workload X; on node Executing query drop workload X; on node Executing query INSERT INTO `postgres_database`.postgresql_replica_3 SELECT number, number from numbers(100000) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_3 SELECT number, number from numbers(100000) on instance http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/18452c5150415bbdf79bf154bba874550cb8bf3f097b4a2da7e93b53375a740d/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/18452c5150415bbdf79bf154bba874550cb8bf3f097b4a2da7e93b53375a740d/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/18452c5150415bbdf79bf154bba874550cb8bf3f097b4a2da7e93b53375a740d/json HTTP/1.1" 200 457 http://localhost:None "GET /v1.46/exec/18452c5150415bbdf79bf154bba874550cb8bf3f097b4a2da7e93b53375a740d/json HTTP/1.1" 200 457 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/8d8a22b3a256ba7e6727054a766e24437355eedc9757ec58cc9ec03f48e22ea3/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/8d8a22b3a256ba7e6727054a766e24437355eedc9757ec58cc9ec03f48e22ea3/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/8d8a22b3a256ba7e6727054a766e24437355eedc9757ec58cc9ec03f48e22ea3/json HTTP/1.1" 200 457 http://localhost:None "GET /v1.46/exec/8d8a22b3a256ba7e6727054a766e24437355eedc9757ec58cc9ec03f48e22ea3/json HTTP/1.1" 200 457 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Executing query INSERT INTO `postgres_database`.postgresql_replica_4 SELECT number, number from numbers(100000) on instance Executing query INSERT INTO `postgres_database`.postgresql_replica_4 SELECT number, number from numbers(100000) on instance Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestreplicatedparsezkmetadata-gw3-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedparsezkmetadata-gw3-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.3.4, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.3.4, port:2181, use_ssl:False Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestreplicatedparsezkmetadata-gw3-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedparsezkmetadata-gw3-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.3.2, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.3.2, port:2181, use_ssl:False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/.env --project-name roottestreplicatedparsezkmetadata-gw3 --file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/.env --project-name roottestreplicatedparsezkmetadata-gw3 --file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/.env --project-name roottestreplicatedparsezkmetadata-gw3 --file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/.env --project-name roottestreplicatedparsezkmetadata-gw3 --file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml up -d --no-recreate] Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node Stderr: Container roottestremoteprewhere-gw6-node2-1 Stopping Stderr: Container roottestremoteprewhere-gw6-node2-1 Stopping Stderr: Container roottestremoteprewhere-gw6-node1-1 Stopping Stderr: Container roottestremoteprewhere-gw6-node1-1 Stopping Stderr: Container roottestremoteprewhere-gw6-node1-1 Stopped Stderr: Container roottestremoteprewhere-gw6-node1-1 Stopped Stderr: Container roottestremoteprewhere-gw6-node2-1 Stopped Stderr: Container roottestremoteprewhere-gw6-node2-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/.env --project-name roottestremoteprewhere-gw6 --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node2/docker-compose.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/.env --project-name roottestremoteprewhere-gw6 --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_remote_prewhere/_instances-0-gw6/node2/docker-compose.yml down --volumes] Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo3-1 Running Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo3-1 Running Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo2-1 Running Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo2-1 Running Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo1-1 Running Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo1-1 Running Stderr: Container roottestreplicatedparsezkmetadata-gw3-node-1 Creating Stderr: Container roottestreplicatedparsezkmetadata-gw3-node-1 Creating Stderr: Container roottestreplicatedparsezkmetadata-gw3-node-1 Created Stderr: Container roottestreplicatedparsezkmetadata-gw3-node-1 Created Stderr: Container roottestreplicatedparsezkmetadata-gw3-node-1 Starting Stderr: Container roottestreplicatedparsezkmetadata-gw3-node-1 Starting Stderr: Container roottestreplicatedparsezkmetadata-gw3-node-1 Started Stderr: Container roottestreplicatedparsezkmetadata-gw3-node-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottestreplicatedparsezkmetadata-gw3-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedparsezkmetadata-gw3-node-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottestreplicatedparsezkmetadata-gw3-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedparsezkmetadata-gw3-node-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node, ip: 172.16.3.5... Waiting for ClickHouse start in node, ip: 172.16.3.5... http://localhost:None "GET /v1.46/containers/roottestreplicatedparsezkmetadata-gw3-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedparsezkmetadata-gw3-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None Executing query select name, create_query from system.resources order by all on node Executing query select name, create_query from system.resources order by all on node http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None Stderr: Container roottestremoteprewhere-gw6-node1-1 Stopping Stderr: Container roottestremoteprewhere-gw6-node1-1 Stopping Stderr: Container roottestremoteprewhere-gw6-node2-1 Stopping Stderr: Container roottestremoteprewhere-gw6-node2-1 Stopping Stderr: Container roottestremoteprewhere-gw6-node2-1 Stopped Stderr: Container roottestremoteprewhere-gw6-node2-1 Stopped Stderr: Container roottestremoteprewhere-gw6-node2-1 Removing Stderr: Container roottestremoteprewhere-gw6-node2-1 Removing Stderr: Container roottestremoteprewhere-gw6-node1-1 Stopped Stderr: Container roottestremoteprewhere-gw6-node1-1 Stopped Stderr: Container roottestremoteprewhere-gw6-node1-1 Removing Stderr: Container roottestremoteprewhere-gw6-node1-1 Removing Stderr: Container roottestremoteprewhere-gw6-node1-1 Removed Stderr: Container roottestremoteprewhere-gw6-node1-1 Removed Stderr: Container roottestremoteprewhere-gw6-node2-1 Removed Stderr: Container roottestremoteprewhere-gw6-node2-1 Removed Stderr: Network roottestremoteprewhere-gw6_default Removing Stderr: Network roottestremoteprewhere-gw6_default Removing Stderr: Network roottestremoteprewhere-gw6_default Removed Stderr: Network roottestremoteprewhere-gw6_default Removed Cleanup called Cleanup called Docker networks for project roottestremoteprewhere-gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestremoteprewhere-gw6 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestremoteprewhere-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestremoteprewhere-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestremoteprewhere-gw6 are DRIVER VOLUME NAME Docker volumes for project roottestremoteprewhere-gw6 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestremoteprewhere-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestremoteprewhere-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestremoteprewhere-gw6 No running containers for project: roottestremoteprewhere-gw6 Trying to prune unused networks... Trying to prune unused networks... Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None Executing query select name, create_query from system.resources order by all on node2 Executing query select name, create_query from system.resources order by all on node2 Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:9 Stdout:9 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 9 Volumes pruned: 9 test_s3_imds/test_simple.py::test_credentials_from_metadata Running tests in /ClickHouse/tests/integration/test_s3_imds/test_simple.py Running tests in /ClickHouse/tests/integration/test_s3_imds/test_simple.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottests3imdssimple-gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3imdssimple-gw6 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3imdssimple-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3imdssimple-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None Docker volumes for project roottests3imdssimple-gw6 are DRIVER VOLUME NAME Docker volumes for project roottests3imdssimple-gw6 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottests3imdssimple-gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3imdssimple-gw6 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3imdssimple-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3imdssimple-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3imdssimple-gw6 are DRIVER VOLUME NAME Docker volumes for project roottests3imdssimple-gw6 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3imdssimple-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3imdssimple-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3imdssimple-gw6 No running containers for project: roottests3imdssimple-gw6 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:9 Stdout:9 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 9 Volumes pruned: 9 Setup directory for instance: node Setup directory for instance: node Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_s3_imds/configs/use_environment_credentials.xml'] to /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_s3_imds/configs/use_environment_credentials.xml'] to /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/configs/config.d Setup database dir /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/database Setup database dir /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/database Setup logs dir /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/logs Setup logs dir /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'AWS_EC2_METADATA_SERVICE_ENDPOINT': 'resolver:8080', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'AWS_EC2_METADATA_SERVICE_ENDPOINT': 'resolver:8080', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env --project-name roottests3imdssimple-gw6 --file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env --project-name roottests3imdssimple-gw6 --file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/c02068d5c26bc89033a67c7b3f453b0811b59f3e341e429e8b14662afa4d64ea/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/c02068d5c26bc89033a67c7b3f453b0811b59f3e341e429e8b14662afa4d64ea/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/exec/c02068d5c26bc89033a67c7b3f453b0811b59f3e341e429e8b14662afa4d64ea/json HTTP/1.1" 200 461 http://localhost:None "GET /v1.46/exec/c02068d5c26bc89033a67c7b3f453b0811b59f3e341e429e8b14662afa4d64ea/json HTTP/1.1" 200 461 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/da8ecd78ea2c030ea65ca205538e17a8f087b66766af5f9f115ca9b9640184ee/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/da8ecd78ea2c030ea65ca205538e17a8f087b66766af5f9f115ca9b9640184ee/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/da8ecd78ea2c030ea65ca205538e17a8f087b66766af5f9f115ca9b9640184ee/json HTTP/1.1" 200 461 http://localhost:None "GET /v1.46/exec/da8ecd78ea2c030ea65ca205538e17a8f087b66766af5f9f115ca9b9640184ee/json HTTP/1.1" 200 461 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): Executing query drop workload Y; on node Executing query drop workload Y; on node http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None Executing query drop workload Z; on node Executing query drop workload Z; on node http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps -C clickhouse] Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 8 ? 00:01:08 clickhouse Stdout: 8 ? 00:01:08 clickhouse run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c pkill clickhouse] Executing query drop workload all; on node Executing query drop workload all; on node http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8 Stdout:8 http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/24a7fb90d15fcc257a5f403bd8a7fd33dd778a861e07d3c925f3473c382bfed0/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/24a7fb90d15fcc257a5f403bd8a7fd33dd778a861e07d3c925f3473c382bfed0/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/exec/24a7fb90d15fcc257a5f403bd8a7fd33dd778a861e07d3c925f3473c382bfed0/json HTTP/1.1" 200 457 http://localhost:None "GET /v1.46/exec/24a7fb90d15fcc257a5f403bd8a7fd33dd778a861e07d3c925f3473c382bfed0/json HTTP/1.1" 200 457 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-d', '172.16.4.10', '--sport', '2181', '-j', 'DROP'] (0): http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/34e59458d2a3638d3e76e013e3512c9fff677f110bd185ef4d1cc196d0281bcb/start HTTP/1.1" 101 0 http://localhost:None "POST /v1.46/exec/34e59458d2a3638d3e76e013e3512c9fff677f110bd185ef4d1cc196d0281bcb/start HTTP/1.1" 101 0 http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/exec/34e59458d2a3638d3e76e013e3512c9fff677f110bd185ef4d1cc196d0281bcb/json HTTP/1.1" 200 457 http://localhost:None "GET /v1.46/exec/34e59458d2a3638d3e76e013e3512c9fff677f110bd185ef4d1cc196d0281bcb/json HTTP/1.1" 200 457 [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): [network] 2995ecf07b37e936c52f8ffa870de3b22d317ee605a0c2fa50d727820ddfe98e: ['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.4.10', '--dport', '2181', '-j', 'DROP'] (0): Executing query select name, create_query from system.workloads order by all on node Executing query select name, create_query from system.workloads order by all on node http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/f51ca5bdbdb90f386799b4cb071e47340734d78e2c52b54a054266379138f495/json HTTP/1.1" 200 None ClickHouse node started ClickHouse node started Executing query CREATE TABLE data ( key Int, INDEX key_idx0 key+0 TYPE minmax GRANULARITY 1, INDEX key_idx1 key+1 TYPE minmax GRANULARITY 1 ) ENGINE = ReplicatedMergeTree('/ch/tables/default/data', 'node') ORDER BY key; on node Executing query CREATE TABLE data ( key Int, INDEX key_idx0 key+0 TYPE minmax GRANULARITY 1, INDEX key_idx1 key+1 TYPE minmax GRANULARITY 1 ) ENGINE = ReplicatedMergeTree('/ch/tables/default/data', 'node') ORDER BY key; on node Executing query select name, create_query from system.workloads order by all on node2 Executing query select name, create_query from system.workloads order by all on node2 Executing query DETACH TABLE data on node Executing query DETACH TABLE data on node Executing query select name, create_query from system.resources order by all on node Executing query select name, create_query from system.resources order by all on node get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreplicatedparsezkmetadata-gw3-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedparsezkmetadata-gw3-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.3.3, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.3.3, port:2181, use_ssl:False Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): SetData(path='/ch/tables/default/data/replicas/node/metadata', data=b'metadata format version: 1\ndate column: \nsampling expression: \nindex granularity: 8192\nmode: 0\nsign column: \nprimary key: key\ndata format version: 1\npartition key: \nindices: key_idx0 key + 0 TYPE minmax GRANULARITY 1, key_idx1 key + 1 TYPE minmax GRANULARITY 1\ngranularity bytes: 10485760\n\n', version=-1) Sending request(xid=1): SetData(path='/ch/tables/default/data/replicas/node/metadata', data=b'metadata format version: 1\ndate column: \nsampling expression: \nindex granularity: 8192\nmode: 0\nsign column: \nprimary key: key\ndata format version: 1\npartition key: \nindices: key_idx0 key + 0 TYPE minmax GRANULARITY 1, key_idx1 key + 1 TYPE minmax GRANULARITY 1\ngranularity bytes: 10485760\n\n', version=-1) Received response(xid=1): ZnodeStat(czxid=10, mzxid=28, ctime=1743562565821, mtime=1743562566123, version=1, cversion=0, aversion=0, ephemeralOwner=0, dataLength=292, numChildren=0, pzxid=10) Received response(xid=1): ZnodeStat(czxid=10, mzxid=28, ctime=1743562565821, mtime=1743562566123, version=1, cversion=0, aversion=0, ephemeralOwner=0, dataLength=292, numChildren=0, pzxid=10) Executing query ATTACH TABLE data on node Executing query ATTACH TABLE data on node run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Stdout:8 Stdout:8 Executing query select name, create_query from system.resources order by all on node2 Executing query select name, create_query from system.resources order by all on node2 Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/.env --project-name roottestreplicatedparsezkmetadata-gw3 --file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/.env --project-name roottestreplicatedparsezkmetadata-gw3 --file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop --timeout 20] [gw3] PASSED test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 Executing query select resource, path, type, weight, priority, max_requests, max_cost, max_speed, max_burst from system.scheduler where resource not in ['network_read', 'network_write'] order by all on node2 [gw1] PASSED test_scheduler/test.py::test_workload_entity_keeper_storage test_scheduler/test.py::test_workload_hierarchy_changes Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Executing query drop workload if exists production; drop workload if exists development; drop workload if exists admin; drop workload if exists all; drop resource if exists io_write; drop resource if exists io_read; drop resource if exists io; on node Stderr: zoo2 Skipped - Image is already being pulled by zoo1 Stderr: zoo2 Skipped - Image is already being pulled by zoo1 Stderr: zoo3 Skipped - Image is already being pulled by zoo1 Stderr: zoo3 Skipped - Image is already being pulled by zoo1 Stderr: node1 Skipped - Image is already being pulled by node2 Stderr: node1 Skipped - Image is already being pulled by node2 Stderr: node2 Pulling Stderr: node2 Pulling Stderr: zoo1 Pulling Stderr: zoo1 Pulling Stderr: zoo1 Pulled Stderr: zoo1 Pulled Stderr: node2 Pulled Stderr: node2 Pulled Setup ZooKeeper Setup ZooKeeper Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper1/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper1/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper1/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper2/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper2/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper2/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper3/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper3/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper3/coordination'] Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper1/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper1/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper1/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper2/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper2/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper2/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper3/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper3/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/keeper3/coordination'] Command:[docker compose --project-name roottestreplicatedmergetreecompatibility-gw7 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Command:[docker compose --project-name roottestreplicatedmergetreecompatibility-gw7 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: minio1 Pulling Stderr: minio1 Pulling Stderr: node Pulling Stderr: node Pulling Stderr: proxy1 Pulling Stderr: proxy1 Pulling Stderr: resolver Pulling Stderr: resolver Pulling Stderr: node Pulled Stderr: node Pulled Stderr: proxy1 Pulled Stderr: proxy1 Pulled Stderr: resolver Pulled Stderr: resolver Pulled Stderr: minio1 Pulled Stderr: minio1 Pulled Trying to create Minio instance by command docker compose --project-name roottests3imdssimple-gw6 --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Trying to create Minio instance by command docker compose --project-name roottests3imdssimple-gw6 --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Command:[docker compose --project-name roottests3imdssimple-gw6 --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Command:[docker compose --project-name roottests3imdssimple-gw6 --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Stdout:8 Stdout:8 run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/resources.xml.default /etc/clickhouse-server/config.d/resources.xml] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] run container_id:roottestscheduler-gw1-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml'] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Command:[docker exec roottestscheduler-gw1-node-1 bash -c cp /etc/clickhouse-server/config.d/workloads.xml.default /etc/clickhouse-server/config.d/workloads.xml] Executing query system reload config on node Executing query system reload config on node Stderr:time="2025-04-02T02:56:07Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:56:07Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestreplicatedmergetreecompatibility-gw7_default Creating Stderr: Network roottestreplicatedmergetreecompatibility-gw7_default Creating Stderr: Network roottestreplicatedmergetreecompatibility-gw7_default Created Stderr: Network roottestreplicatedmergetreecompatibility-gw7_default Created Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo2-1 Creating Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo2-1 Creating Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo1-1 Creating Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo1-1 Creating Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo3-1 Creating Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo3-1 Creating Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo1-1 Created Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo1-1 Created Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo3-1 Created Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo3-1 Created Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo2-1 Created Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo2-1 Created Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo1-1 Starting Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo1-1 Starting Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo2-1 Starting Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo2-1 Starting Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo3-1 Starting Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo3-1 Starting Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo3-1 Started Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo3-1 Started Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo1-1 Started Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo1-1 Started Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo2-1 Started Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo2-1 Started Stderr:time="2025-04-02T02:56:07Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:56:07Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:56:07Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:56:07Z" level=debug msg="otel error" error="" Wait ZooKeeper to start Wait ZooKeeper to start get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw7-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw7-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.2.4, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.2.4, port:2181, use_ssl:False Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query create resource io_write (write disk s3_no_resource); on node Executing query create resource io_write (write disk s3_no_resource); on node run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8 Stdout:8 Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Stderr:time="2025-04-02T02:56:07Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:56:07Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottests3imdssimple-gw6_default Creating Stderr: Network roottests3imdssimple-gw6_default Creating Stderr: Network roottests3imdssimple-gw6_default Created Stderr: Network roottests3imdssimple-gw6_default Created Stderr: Volume "roottests3imdssimple-gw6_data1-1" Creating Stderr: Volume "roottests3imdssimple-gw6_data1-1" Creating Stderr: Volume "roottests3imdssimple-gw6_data1-1" Created Stderr: Volume "roottests3imdssimple-gw6_data1-1" Created Stderr: Container roottests3imdssimple-gw6-proxy1-1 Creating Stderr: Container roottests3imdssimple-gw6-proxy1-1 Creating Stderr: Container roottests3imdssimple-gw6-proxy2-1 Creating Stderr: Container roottests3imdssimple-gw6-proxy2-1 Creating Stderr: Container roottests3imdssimple-gw6-proxy2-1 Created Stderr: Container roottests3imdssimple-gw6-proxy2-1 Created Stderr: Container roottests3imdssimple-gw6-proxy1-1 Created Stderr: Container roottests3imdssimple-gw6-proxy1-1 Created Stderr: Container roottests3imdssimple-gw6-resolver-1 Creating Stderr: Container roottests3imdssimple-gw6-resolver-1 Creating Stderr: Container roottests3imdssimple-gw6-minio1-1 Creating Stderr: Container roottests3imdssimple-gw6-minio1-1 Creating Stderr: Container roottests3imdssimple-gw6-resolver-1 Created Stderr: Container roottests3imdssimple-gw6-resolver-1 Created Stderr: Container roottests3imdssimple-gw6-minio1-1 Created Stderr: Container roottests3imdssimple-gw6-minio1-1 Created Stderr: Container roottests3imdssimple-gw6-proxy2-1 Starting Stderr: Container roottests3imdssimple-gw6-proxy2-1 Starting Stderr: Container roottests3imdssimple-gw6-proxy1-1 Starting Stderr: Container roottests3imdssimple-gw6-proxy1-1 Starting Stderr: Container roottests3imdssimple-gw6-proxy1-1 Started Stderr: Container roottests3imdssimple-gw6-proxy1-1 Started Stderr: Container roottests3imdssimple-gw6-proxy2-1 Started Stderr: Container roottests3imdssimple-gw6-proxy2-1 Started Stderr: Container roottests3imdssimple-gw6-resolver-1 Starting Stderr: Container roottests3imdssimple-gw6-resolver-1 Starting Stderr: Container roottests3imdssimple-gw6-minio1-1 Starting Stderr: Container roottests3imdssimple-gw6-minio1-1 Starting Stderr: Container roottests3imdssimple-gw6-minio1-1 Started Stderr: Container roottests3imdssimple-gw6-minio1-1 Started Stderr: Container roottests3imdssimple-gw6-resolver-1 Started Stderr: Container roottests3imdssimple-gw6-resolver-1 Started Stderr:time="2025-04-02T02:56:08Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:56:08Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:56:08Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:56:08Z" level=debug msg="otel error" error="" Trying to connect to Minio... Trying to connect to Minio... get_instance_ip instance_name=minio1 get_instance_ip instance_name=minio1 http://localhost:None "GET /v1.46/containers/roottests3imdssimple-gw6-minio1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3imdssimple-gw6-minio1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy1 get_instance_ip instance_name=proxy1 http://localhost:None "GET /v1.46/containers/roottests3imdssimple-gw6-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3imdssimple-gw6-proxy1-1/json HTTP/1.1" 200 None Starting new HTTP connection (1): 172.16.6.5:9001 Starting new HTTP connection (1): 172.16.6.5:9001 Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (2): 172.16.6.5:9001 Starting new HTTP connection (2): 172.16.6.5:9001 Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (3): 172.16.6.5:9001 Starting new HTTP connection (3): 172.16.6.5:9001 Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (4): 172.16.6.5:9001 Starting new HTTP connection (4): 172.16.6.5:9001 Can't connect to Minio: HTTPConnectionPool(host='172.16.6.5', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Can't connect to Minio: HTTPConnectionPool(host='172.16.6.5', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Executing query create resource io_read (read disk s3_no_resource); on node Executing query create resource io_read (read disk s3_no_resource); on node Executing query create workload all; on node Executing query create workload all; on node Executing query create workload X in all settings priority = 0; on node Executing query create workload X in all settings priority = 0; on node Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query create workload Y in all settings priority = 1; on node Executing query create workload Y in all settings priority = 1; on node run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestpostgresqlreplicadatabaseengine1-gw0-instance-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestpostgresqlreplicadatabaseengine1-gw0-instance-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/e804d0f32cbb9da64c86fc2dd21520afa41f4cd9c5301fbfb1b37f7ee9404600/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/e804d0f32cbb9da64c86fc2dd21520afa41f4cd9c5301fbfb1b37f7ee9404600/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/e804d0f32cbb9da64c86fc2dd21520afa41f4cd9c5301fbfb1b37f7ee9404600/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/e804d0f32cbb9da64c86fc2dd21520afa41f4cd9c5301fbfb1b37f7ee9404600/json HTTP/1.1" 200 586 Starting new HTTP connection (5): 172.16.6.5:9001 Starting new HTTP connection (5): 172.16.6.5:9001 http://172.16.6.5:9001 "GET / HTTP/1.1" 200 0 http://172.16.6.5:9001 "GET / HTTP/1.1" 200 0 Connected to Minio. Connected to Minio. http://172.16.6.5:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.6.5:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.6.5:9001 "PUT /root HTTP/1.1" 200 0 http://172.16.6.5:9001 "PUT /root HTTP/1.1" 200 0 S3 bucket 'root' created S3 bucket 'root' created http://172.16.6.5:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.6.5:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.6.5:9001 "PUT /root2 HTTP/1.1" 200 0 http://172.16.6.5:9001 "PUT /root2 HTTP/1.1" 200 0 S3 bucket 'root2' created S3 bucket 'root2' created ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env --project-name roottests3imdssimple-gw6 --file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env --project-name roottests3imdssimple-gw6 --file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env --project-name roottests3imdssimple-gw6 --file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env --project-name roottests3imdssimple-gw6 --file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Executing query create workload A1 in X settings priority = -1; on node Executing query create workload A1 in X settings priority = -1; on node Executing query create workload B1 in X settings priority = 1; on node Executing query create workload B1 in X settings priority = 1; on node Stderr: Container roottests3imdssimple-gw6-proxy2-1 Running Stderr: Container roottests3imdssimple-gw6-proxy2-1 Running Stderr: Container roottests3imdssimple-gw6-proxy1-1 Running Stderr: Container roottests3imdssimple-gw6-proxy1-1 Running Stderr: Container roottests3imdssimple-gw6-resolver-1 Running Stderr: Container roottests3imdssimple-gw6-resolver-1 Running Stderr: Container roottests3imdssimple-gw6-minio1-1 Running Stderr: Container roottests3imdssimple-gw6-minio1-1 Running Stderr: Container roottests3imdssimple-gw6-node-1 Creating Stderr: Container roottests3imdssimple-gw6-node-1 Creating Stderr: Container roottests3imdssimple-gw6-node-1 Created Stderr: Container roottests3imdssimple-gw6-node-1 Created Stderr: Container roottests3imdssimple-gw6-node-1 Starting Stderr: Container roottests3imdssimple-gw6-node-1 Starting Stderr: Container roottests3imdssimple-gw6-node-1 Started Stderr: Container roottests3imdssimple-gw6-node-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottests3imdssimple-gw6-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3imdssimple-gw6-node-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottests3imdssimple-gw6-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3imdssimple-gw6-node-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node, ip: 172.16.6.6... Waiting for ClickHouse start in node, ip: 172.16.6.6... http://localhost:None "GET /v1.46/containers/roottests3imdssimple-gw6-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3imdssimple-gw6-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None Executing query create workload C1 in Y settings priority = -1; on node Executing query create workload C1 in Y settings priority = -1; on node http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None Executing query create workload D1 in Y settings priority = 1; on node Executing query create workload D1 in Y settings priority = 1; on node http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query create workload A2 in X settings priority = -1; on node Executing query create workload A2 in X settings priority = -1; on node Stdout:775 Stdout:775 Clickhouse process running. Clickhouse process running. run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:775 Stdout:775 Executing query select 20 on instance Executing query select 20 on instance http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None Executing query create workload B2 in X settings priority = 1; on node Executing query create workload B2 in X settings priority = 1; on node http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None Executing query create workload C2 in Y settings priority = -1; on node Executing query create workload C2 in Y settings priority = -1; on node Stderr: Container roottests3latencylog-gw5-node-1 Stopping Stderr: Container roottests3latencylog-gw5-node-1 Stopping Stderr: Container roottests3latencylog-gw5-resolver-1 Stopping Stderr: Container roottests3latencylog-gw5-resolver-1 Stopping Stderr: Container roottests3latencylog-gw5-node-1 Stopped Stderr: Container roottests3latencylog-gw5-node-1 Stopped Stderr: Container roottests3latencylog-gw5-minio1-1 Stopping Stderr: Container roottests3latencylog-gw5-minio1-1 Stopping Stderr: Container roottests3latencylog-gw5-minio1-1 Stopped Stderr: Container roottests3latencylog-gw5-minio1-1 Stopped Stderr: Container roottests3latencylog-gw5-resolver-1 Stopped Stderr: Container roottests3latencylog-gw5-resolver-1 Stopped Stderr: Container roottests3latencylog-gw5-proxy1-1 Stopping Stderr: Container roottests3latencylog-gw5-proxy1-1 Stopping Stderr: Container roottests3latencylog-gw5-proxy2-1 Stopping Stderr: Container roottests3latencylog-gw5-proxy2-1 Stopping Stderr: Container roottests3latencylog-gw5-proxy2-1 Stopped Stderr: Container roottests3latencylog-gw5-proxy2-1 Stopped Stderr: Container roottests3latencylog-gw5-proxy1-1 Stopped Stderr: Container roottests3latencylog-gw5-proxy1-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/.env --project-name roottests3latencylog-gw5 --file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/.env --project-name roottests3latencylog-gw5 --file /ClickHouse/tests/integration/test_s3_latency_log/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Executing query select 20 on instance Executing query select 20 on instance http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None Executing query create workload D2 in Y settings priority = 1; on node Executing query create workload D2 in Y settings priority = 1; on node http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None Executing query drop workload A1; on node Executing query drop workload A1; on node http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None Executing query drop workload A2; on node Executing query drop workload A2; on node http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None Stderr: Container roottests3latencylog-gw5-node-1 Stopping Stderr: Container roottests3latencylog-gw5-node-1 Stopping Stderr: Container roottests3latencylog-gw5-resolver-1 Stopping Stderr: Container roottests3latencylog-gw5-resolver-1 Stopping Stderr: Container roottests3latencylog-gw5-node-1 Stopped Stderr: Container roottests3latencylog-gw5-node-1 Stopped Stderr: Container roottests3latencylog-gw5-node-1 Removing Stderr: Container roottests3latencylog-gw5-node-1 Removing Stderr: Container roottests3latencylog-gw5-resolver-1 Stopped Stderr: Container roottests3latencylog-gw5-resolver-1 Stopped Stderr: Container roottests3latencylog-gw5-resolver-1 Removing Stderr: Container roottests3latencylog-gw5-resolver-1 Removing Stderr: Container roottests3latencylog-gw5-node-1 Removed Stderr: Container roottests3latencylog-gw5-node-1 Removed Stderr: Container roottests3latencylog-gw5-minio1-1 Stopping Stderr: Container roottests3latencylog-gw5-minio1-1 Stopping Stderr: Container roottests3latencylog-gw5-minio1-1 Stopped Stderr: Container roottests3latencylog-gw5-minio1-1 Stopped Stderr: Container roottests3latencylog-gw5-minio1-1 Removing Stderr: Container roottests3latencylog-gw5-minio1-1 Removing Stderr: Container roottests3latencylog-gw5-resolver-1 Removed Stderr: Container roottests3latencylog-gw5-resolver-1 Removed Stderr: Container roottests3latencylog-gw5-minio1-1 Removed Stderr: Container roottests3latencylog-gw5-minio1-1 Removed Stderr: Container roottests3latencylog-gw5-proxy1-1 Stopping Stderr: Container roottests3latencylog-gw5-proxy1-1 Stopping Stderr: Container roottests3latencylog-gw5-proxy2-1 Stopping Stderr: Container roottests3latencylog-gw5-proxy2-1 Stopping Stderr: Container roottests3latencylog-gw5-proxy1-1 Stopped Stderr: Container roottests3latencylog-gw5-proxy1-1 Stopped Stderr: Container roottests3latencylog-gw5-proxy1-1 Removing Stderr: Container roottests3latencylog-gw5-proxy1-1 Removing Stderr: Container roottests3latencylog-gw5-proxy2-1 Stopped Stderr: Container roottests3latencylog-gw5-proxy2-1 Stopped Stderr: Container roottests3latencylog-gw5-proxy2-1 Removing Stderr: Container roottests3latencylog-gw5-proxy2-1 Removing Stderr: Container roottests3latencylog-gw5-proxy1-1 Removed Stderr: Container roottests3latencylog-gw5-proxy1-1 Removed Stderr: Container roottests3latencylog-gw5-proxy2-1 Removed Stderr: Container roottests3latencylog-gw5-proxy2-1 Removed Stderr: Volume roottests3latencylog-gw5_data1-1 Removing Stderr: Volume roottests3latencylog-gw5_data1-1 Removing Stderr: Network roottests3latencylog-gw5_default Removing Stderr: Network roottests3latencylog-gw5_default Removing Stderr: Volume roottests3latencylog-gw5_data1-1 Removed Stderr: Volume roottests3latencylog-gw5_data1-1 Removed Stderr: Network roottests3latencylog-gw5_default Removed Stderr: Network roottests3latencylog-gw5_default Removed Cleanup called Cleanup called Docker networks for project roottests3latencylog-gw5 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3latencylog-gw5 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3latencylog-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3latencylog-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3latencylog-gw5 are DRIVER VOLUME NAME Docker volumes for project roottests3latencylog-gw5 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3latencylog-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3latencylog-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3latencylog-gw5 No running containers for project: roottests3latencylog-gw5 Trying to prune unused networks... Trying to prune unused networks... http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:9 Stdout:9 Command:[docker volume prune -f] Command:[docker volume prune -f] Executing query select 20 on instance Executing query select 20 on instance Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 9 Volumes pruned: 9 test_s3_storage_class/test.py::test_s3_storage_class_right Running tests in /ClickHouse/tests/integration/test_s3_storage_class/test.py Running tests in /ClickHouse/tests/integration/test_s3_storage_class/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottests3storageclass-gw5 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3storageclass-gw5 are NETWORK ID NAME DRIVER SCOPE http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28f19437421000b7ccbcb293179b0c659723430ac87845bfe8f0d2a3ea41a8b5/json HTTP/1.1" 200 None ClickHouse node started ClickHouse node started Starting mock server simple_server.py Starting mock server simple_server.py run container_id:roottests3imdssimple-gw6-resolver-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname simple_server.py) && echo aW1wb3J0IGh0dHAuc2VydmVyCmltcG9ydCBzeXMKCgpjbGFzcyBSZXF1ZXN0SGFuZGxlcihodHRwLnNlcnZlci5CYXNlSFRUUFJlcXVlc3RIYW5kbGVyKToKICAgIGRlZiBnZXRfcmVzcG9uc2Uoc2VsZik6CiAgICAgICAgaWYgc2VsZi5wYXRoID09ICIvIjoKICAgICAgICAgICAgcmV0dXJuICJPSyIsIDIwMAoKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi9sYXRlc3QvbWV0YS1kYXRhL2lhbS9zZWN1cml0eS1jcmVkZW50aWFscyI6CiAgICAgICAgICAgIHJldHVybiAibXlyb2xlIiwgMjAwCgogICAgICAgIGlmIHNlbGYucGF0aCA9PSAiL2xhdGVzdC9tZXRhLWRhdGEvaWFtL3NlY3VyaXR5LWNyZWRlbnRpYWxzL215cm9sZSI6CiAgICAgICAgICAgIHJldHVybiAoCiAgICAgICAgICAgICAgICAneyAiQ29kZSIgOiAiU3VjY2VzcyIsICJUeXBlIiA6ICJBV1MtSE1BQyIsICJBY2Nlc3NLZXlJZCIgOiAibWluaW8iLCAiU2VjcmV0QWNjZXNzS2V5IiA6ICJtaW5pbzEyMyIgfScsCiAgICAgICAgICAgICAgICAyMDAsCiAgICAgICAgICAgICkKCiAgICAgICAgIyBSZXNvdXJjZSBub3QgZm91bmQuCiAgICAgICAgcmV0dXJuIDQwNAoKICAgIGRlZiBkb19IRUFEKHNlbGYpOgogICAgICAgIHJlc3BvbnNlLCBjb2RlID0gc2VsZi5nZXRfcmVzcG9uc2UoKQogICAgICAgIHNlbGYuc2VuZF9yZXNwb25zZShjb2RlKQogICAgICAgIHNlbGYuc2VuZF9oZWFkZXIoIkNvbnRlbnQtVHlwZSIsICJ0ZXh0L3BsYWluIikKICAgICAgICBzZWxmLnNlbmRfaGVhZGVyKCJDb250ZW50LUxlbmd0aCIsIGxlbihyZXNwb25zZS5lbmNvZGUoKSkpCiAgICAgICAgc2VsZi5lbmRfaGVhZGVycygpCiAgICAgICAgcmV0dXJuIHJlc3BvbnNlLCBjb2RlCgogICAgZGVmIGRvX0dFVChzZWxmKToKICAgICAgICByZXNwb25zZSwgXyA9IHNlbGYuZG9fSEVBRCgpCiAgICAgICAgc2VsZi53ZmlsZS53cml0ZShyZXNwb25zZS5lbmNvZGUoKSkKCgpodHRwZCA9IGh0dHAuc2VydmVyLkhUVFBTZXJ2ZXIoKCIwLjAuMC4wIiwgaW50KHN5cy5hcmd2WzFdKSksIFJlcXVlc3RIYW5kbGVyKQpodHRwZC5zZXJ2ZV9mb3JldmVyKCkK | base64 --decode > simple_server.py'] run container_id:roottests3imdssimple-gw6-resolver-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname simple_server.py) && echo aW1wb3J0IGh0dHAuc2VydmVyCmltcG9ydCBzeXMKCgpjbGFzcyBSZXF1ZXN0SGFuZGxlcihodHRwLnNlcnZlci5CYXNlSFRUUFJlcXVlc3RIYW5kbGVyKToKICAgIGRlZiBnZXRfcmVzcG9uc2Uoc2VsZik6CiAgICAgICAgaWYgc2VsZi5wYXRoID09ICIvIjoKICAgICAgICAgICAgcmV0dXJuICJPSyIsIDIwMAoKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi9sYXRlc3QvbWV0YS1kYXRhL2lhbS9zZWN1cml0eS1jcmVkZW50aWFscyI6CiAgICAgICAgICAgIHJldHVybiAibXlyb2xlIiwgMjAwCgogICAgICAgIGlmIHNlbGYucGF0aCA9PSAiL2xhdGVzdC9tZXRhLWRhdGEvaWFtL3NlY3VyaXR5LWNyZWRlbnRpYWxzL215cm9sZSI6CiAgICAgICAgICAgIHJldHVybiAoCiAgICAgICAgICAgICAgICAneyAiQ29kZSIgOiAiU3VjY2VzcyIsICJUeXBlIiA6ICJBV1MtSE1BQyIsICJBY2Nlc3NLZXlJZCIgOiAibWluaW8iLCAiU2VjcmV0QWNjZXNzS2V5IiA6ICJtaW5pbzEyMyIgfScsCiAgICAgICAgICAgICAgICAyMDAsCiAgICAgICAgICAgICkKCiAgICAgICAgIyBSZXNvdXJjZSBub3QgZm91bmQuCiAgICAgICAgcmV0dXJuIDQwNAoKICAgIGRlZiBkb19IRUFEKHNlbGYpOgogICAgICAgIHJlc3BvbnNlLCBjb2RlID0gc2VsZi5nZXRfcmVzcG9uc2UoKQogICAgICAgIHNlbGYuc2VuZF9yZXNwb25zZShjb2RlKQogICAgICAgIHNlbGYuc2VuZF9oZWFkZXIoIkNvbnRlbnQtVHlwZSIsICJ0ZXh0L3BsYWluIikKICAgICAgICBzZWxmLnNlbmRfaGVhZGVyKCJDb250ZW50LUxlbmd0aCIsIGxlbihyZXNwb25zZS5lbmNvZGUoKSkpCiAgICAgICAgc2VsZi5lbmRfaGVhZGVycygpCiAgICAgICAgcmV0dXJuIHJlc3BvbnNlLCBjb2RlCgogICAgZGVmIGRvX0dFVChzZWxmKToKICAgICAgICByZXNwb25zZSwgXyA9IHNlbGYuZG9fSEVBRCgpCiAgICAgICAgc2VsZi53ZmlsZS53cml0ZShyZXNwb25zZS5lbmNvZGUoKSkKCgpodHRwZCA9IGh0dHAuc2VydmVyLkhUVFBTZXJ2ZXIoKCIwLjAuMC4wIiwgaW50KHN5cy5hcmd2WzFdKSksIFJlcXVlc3RIYW5kbGVyKQpodHRwZC5zZXJ2ZV9mb3JldmVyKCkK | base64 --decode > simple_server.py'] Command:[docker exec roottests3imdssimple-gw6-resolver-1 bash -c mkdir -p $(dirname simple_server.py) && echo aW1wb3J0IGh0dHAuc2VydmVyCmltcG9ydCBzeXMKCgpjbGFzcyBSZXF1ZXN0SGFuZGxlcihodHRwLnNlcnZlci5CYXNlSFRUUFJlcXVlc3RIYW5kbGVyKToKICAgIGRlZiBnZXRfcmVzcG9uc2Uoc2VsZik6CiAgICAgICAgaWYgc2VsZi5wYXRoID09ICIvIjoKICAgICAgICAgICAgcmV0dXJuICJPSyIsIDIwMAoKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi9sYXRlc3QvbWV0YS1kYXRhL2lhbS9zZWN1cml0eS1jcmVkZW50aWFscyI6CiAgICAgICAgICAgIHJldHVybiAibXlyb2xlIiwgMjAwCgogICAgICAgIGlmIHNlbGYucGF0aCA9PSAiL2xhdGVzdC9tZXRhLWRhdGEvaWFtL3NlY3VyaXR5LWNyZWRlbnRpYWxzL215cm9sZSI6CiAgICAgICAgICAgIHJldHVybiAoCiAgICAgICAgICAgICAgICAneyAiQ29kZSIgOiAiU3VjY2VzcyIsICJUeXBlIiA6ICJBV1MtSE1BQyIsICJBY2Nlc3NLZXlJZCIgOiAibWluaW8iLCAiU2VjcmV0QWNjZXNzS2V5IiA6ICJtaW5pbzEyMyIgfScsCiAgICAgICAgICAgICAgICAyMDAsCiAgICAgICAgICAgICkKCiAgICAgICAgIyBSZXNvdXJjZSBub3QgZm91bmQuCiAgICAgICAgcmV0dXJuIDQwNAoKICAgIGRlZiBkb19IRUFEKHNlbGYpOgogICAgICAgIHJlc3BvbnNlLCBjb2RlID0gc2VsZi5nZXRfcmVzcG9uc2UoKQogICAgICAgIHNlbGYuc2VuZF9yZXNwb25zZShjb2RlKQogICAgICAgIHNlbGYuc2VuZF9oZWFkZXIoIkNvbnRlbnQtVHlwZSIsICJ0ZXh0L3BsYWluIikKICAgICAgICBzZWxmLnNlbmRfaGVhZGVyKCJDb250ZW50LUxlbmd0aCIsIGxlbihyZXNwb25zZS5lbmNvZGUoKSkpCiAgICAgICAgc2VsZi5lbmRfaGVhZGVycygpCiAgICAgICAgcmV0dXJuIHJlc3BvbnNlLCBjb2RlCgogICAgZGVmIGRvX0dFVChzZWxmKToKICAgICAgICByZXNwb25zZSwgXyA9IHNlbGYuZG9fSEVBRCgpCiAgICAgICAgc2VsZi53ZmlsZS53cml0ZShyZXNwb25zZS5lbmNvZGUoKSkKCgpodHRwZCA9IGh0dHAuc2VydmVyLkhUVFBTZXJ2ZXIoKCIwLjAuMC4wIiwgaW50KHN5cy5hcmd2WzFdKSksIFJlcXVlc3RIYW5kbGVyKQpodHRwZC5zZXJ2ZV9mb3JldmVyKCkK | base64 --decode > simple_server.py] Command:[docker exec roottests3imdssimple-gw6-resolver-1 bash -c mkdir -p $(dirname simple_server.py) && echo aW1wb3J0IGh0dHAuc2VydmVyCmltcG9ydCBzeXMKCgpjbGFzcyBSZXF1ZXN0SGFuZGxlcihodHRwLnNlcnZlci5CYXNlSFRUUFJlcXVlc3RIYW5kbGVyKToKICAgIGRlZiBnZXRfcmVzcG9uc2Uoc2VsZik6CiAgICAgICAgaWYgc2VsZi5wYXRoID09ICIvIjoKICAgICAgICAgICAgcmV0dXJuICJPSyIsIDIwMAoKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi9sYXRlc3QvbWV0YS1kYXRhL2lhbS9zZWN1cml0eS1jcmVkZW50aWFscyI6CiAgICAgICAgICAgIHJldHVybiAibXlyb2xlIiwgMjAwCgogICAgICAgIGlmIHNlbGYucGF0aCA9PSAiL2xhdGVzdC9tZXRhLWRhdGEvaWFtL3NlY3VyaXR5LWNyZWRlbnRpYWxzL215cm9sZSI6CiAgICAgICAgICAgIHJldHVybiAoCiAgICAgICAgICAgICAgICAneyAiQ29kZSIgOiAiU3VjY2VzcyIsICJUeXBlIiA6ICJBV1MtSE1BQyIsICJBY2Nlc3NLZXlJZCIgOiAibWluaW8iLCAiU2VjcmV0QWNjZXNzS2V5IiA6ICJtaW5pbzEyMyIgfScsCiAgICAgICAgICAgICAgICAyMDAsCiAgICAgICAgICAgICkKCiAgICAgICAgIyBSZXNvdXJjZSBub3QgZm91bmQuCiAgICAgICAgcmV0dXJuIDQwNAoKICAgIGRlZiBkb19IRUFEKHNlbGYpOgogICAgICAgIHJlc3BvbnNlLCBjb2RlID0gc2VsZi5nZXRfcmVzcG9uc2UoKQogICAgICAgIHNlbGYuc2VuZF9yZXNwb25zZShjb2RlKQogICAgICAgIHNlbGYuc2VuZF9oZWFkZXIoIkNvbnRlbnQtVHlwZSIsICJ0ZXh0L3BsYWluIikKICAgICAgICBzZWxmLnNlbmRfaGVhZGVyKCJDb250ZW50LUxlbmd0aCIsIGxlbihyZXNwb25zZS5lbmNvZGUoKSkpCiAgICAgICAgc2VsZi5lbmRfaGVhZGVycygpCiAgICAgICAgcmV0dXJuIHJlc3BvbnNlLCBjb2RlCgogICAgZGVmIGRvX0dFVChzZWxmKToKICAgICAgICByZXNwb25zZSwgXyA9IHNlbGYuZG9fSEVBRCgpCiAgICAgICAgc2VsZi53ZmlsZS53cml0ZShyZXNwb25zZS5lbmNvZGUoKSkKCgpodHRwZCA9IGh0dHAuc2VydmVyLkhUVFBTZXJ2ZXIoKCIwLjAuMC4wIiwgaW50KHN5cy5hcmd2WzFdKSksIFJlcXVlc3RIYW5kbGVyKQpodHRwZC5zZXJ2ZV9mb3JldmVyKCkK | base64 --decode > simple_server.py] Docker containers for project roottests3storageclass-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3storageclass-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Executing query drop workload B1; on node Executing query drop workload B1; on node Docker volumes for project roottests3storageclass-gw5 are DRIVER VOLUME NAME Docker volumes for project roottests3storageclass-gw5 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottests3storageclass-gw5 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3storageclass-gw5 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3storageclass-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3storageclass-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES run container_id:roottests3imdssimple-gw6-resolver-1 detach:True nothrow:False cmd: ['bash', '-c', 'python3 simple_server.py 8080 >/var/log/resolver/simple_server.log 2>/var/log/resolver/simple_server.err.log'] run container_id:roottests3imdssimple-gw6-resolver-1 detach:True nothrow:False cmd: ['bash', '-c', 'python3 simple_server.py 8080 >/var/log/resolver/simple_server.log 2>/var/log/resolver/simple_server.err.log'] Command:[docker exec roottests3imdssimple-gw6-resolver-1 bash -c python3 simple_server.py 8080 >/var/log/resolver/simple_server.log 2>/var/log/resolver/simple_server.err.log] Command:[docker exec roottests3imdssimple-gw6-resolver-1 bash -c python3 simple_server.py 8080 >/var/log/resolver/simple_server.log 2>/var/log/resolver/simple_server.err.log] run container_id:roottests3imdssimple-gw6-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] run container_id:roottests3imdssimple-gw6-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] Command:[docker exec roottests3imdssimple-gw6-resolver-1 curl -s http://localhost:8080/] Command:[docker exec roottests3imdssimple-gw6-resolver-1 curl -s http://localhost:8080/] Docker volumes for project roottests3storageclass-gw5 are DRIVER VOLUME NAME Docker volumes for project roottests3storageclass-gw5 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3storageclass-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3storageclass-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3storageclass-gw5 No running containers for project: roottests3storageclass-gw5 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Exitcode:7 Exitcode:7 Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:9 Stdout:9 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 9 Volumes pruned: 9 Setup directory for instance: node Setup directory for instance: node Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_s3_storage_class/configs/config.d/minio.xml'] to /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/node/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_s3_storage_class/configs/config.d/minio.xml'] to /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/node/configs/config.d Setup database dir /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/node/database Setup database dir /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/node/database Setup logs dir /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/node/logs Setup logs dir /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/node/logs Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/.env --project-name roottests3storageclass-gw5 --file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/.env --project-name roottests3storageclass-gw5 --file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Executing query drop workload B2; on node Executing query drop workload B2; on node Executing query drop workload C1; on node Executing query drop workload C1; on node Executing query select 20 on instance Executing query select 20 on instance Executing query drop workload C2; on node Executing query drop workload C2; on node Executing query drop workload D1; on node Executing query drop workload D1; on node Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Executing query drop workload D2; on node Executing query drop workload D2; on node Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw7-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw7-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.2.3, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.2.3, port:2181, use_ssl:False Connecting to 172.16.2.3(172.16.2.3):2181, use_ssl: False Connecting to 172.16.2.3(172.16.2.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost run container_id:roottests3imdssimple-gw6-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] run container_id:roottests3imdssimple-gw6-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] Command:[docker exec roottests3imdssimple-gw6-resolver-1 curl -s http://localhost:8080/] Command:[docker exec roottests3imdssimple-gw6-resolver-1 curl -s http://localhost:8080/] Stdout:OK Stdout:OK simple_server.py answered OK on attempt 2 simple_server.py answered OK on attempt 2 Mock server simple_server.py started Mock server simple_server.py started Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/test1.jsonl') SELECT * FROM numbers(100) on node Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/test1.jsonl') SELECT * FROM numbers(100) on node Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw7-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw7-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.2.2, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.2.2, port:2181, use_ssl:False Connecting to 172.16.2.2(172.16.2.2):2181, use_ssl: False Connecting to 172.16.2.2(172.16.2.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Executing query select 20 on instance Executing query select 20 on instance Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/.env --project-name roottestreplicatedmergetreecompatibility-gw7 --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node2/docker-compose.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/.env --project-name roottestreplicatedmergetreecompatibility-gw7 --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node2/docker-compose.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/.env --project-name roottestreplicatedmergetreecompatibility-gw7 --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node2/docker-compose.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/.env --project-name roottestreplicatedmergetreecompatibility-gw7 --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node2/docker-compose.yml up -d --no-recreate] Executing query create workload Z in all; on node Executing query create workload Z in all; on node Executing query create workload A1 in Z settings priority = -1; on node Executing query create workload A1 in Z settings priority = -1; on node Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT count() FROM s3('http://minio1:9001/root/test1.jsonl') on node Executing query SELECT count() FROM s3('http://minio1:9001/root/test1.jsonl') on node Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo3-1 Running Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo3-1 Running Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo2-1 Running Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo2-1 Running Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo1-1 Running Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo1-1 Running Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node1-1 Creating Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node1-1 Creating Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node2-1 Creating Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node2-1 Creating Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node2-1 Created Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node2-1 Created Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node1-1 Created Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node1-1 Created Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node1-1 Starting Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node1-1 Starting Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node2-1 Starting Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node2-1 Starting Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node1-1 Started Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node1-1 Started Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node2-1 Started Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node2-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw7-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw7-node1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw7-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw7-node1-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node1, ip: 172.16.2.5... Waiting for ClickHouse start in node1, ip: 172.16.2.5... http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw7-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw7-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/39d7e7ed16ce662454975c5f2d438b3acb08aaa567ff75320ff5d1b69fc7f46b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/39d7e7ed16ce662454975c5f2d438b3acb08aaa567ff75320ff5d1b69fc7f46b/json HTTP/1.1" 200 None Executing query create workload A2 in Z settings priority = -1; on node Executing query create workload A2 in Z settings priority = -1; on node http://localhost:None "GET /v1.46/containers/39d7e7ed16ce662454975c5f2d438b3acb08aaa567ff75320ff5d1b69fc7f46b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/39d7e7ed16ce662454975c5f2d438b3acb08aaa567ff75320ff5d1b69fc7f46b/json HTTP/1.1" 200 None Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance http://localhost:None "GET /v1.46/containers/39d7e7ed16ce662454975c5f2d438b3acb08aaa567ff75320ff5d1b69fc7f46b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/39d7e7ed16ce662454975c5f2d438b3acb08aaa567ff75320ff5d1b69fc7f46b/json HTTP/1.1" 200 None Executing query SYSTEM FLUSH LOGS on node Executing query SYSTEM FLUSH LOGS on node http://localhost:None "GET /v1.46/containers/39d7e7ed16ce662454975c5f2d438b3acb08aaa567ff75320ff5d1b69fc7f46b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/39d7e7ed16ce662454975c5f2d438b3acb08aaa567ff75320ff5d1b69fc7f46b/json HTTP/1.1" 200 None Executing query create workload A3 in Z settings priority = -1; on node Executing query create workload A3 in Z settings priority = -1; on node Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance http://localhost:None "GET /v1.46/containers/39d7e7ed16ce662454975c5f2d438b3acb08aaa567ff75320ff5d1b69fc7f46b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/39d7e7ed16ce662454975c5f2d438b3acb08aaa567ff75320ff5d1b69fc7f46b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/39d7e7ed16ce662454975c5f2d438b3acb08aaa567ff75320ff5d1b69fc7f46b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/39d7e7ed16ce662454975c5f2d438b3acb08aaa567ff75320ff5d1b69fc7f46b/json HTTP/1.1" 200 None Executing query create workload B1 in Z settings priority = 1; on node Executing query create workload B1 in Z settings priority = 1; on node http://localhost:None "GET /v1.46/containers/39d7e7ed16ce662454975c5f2d438b3acb08aaa567ff75320ff5d1b69fc7f46b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/39d7e7ed16ce662454975c5f2d438b3acb08aaa567ff75320ff5d1b69fc7f46b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/39d7e7ed16ce662454975c5f2d438b3acb08aaa567ff75320ff5d1b69fc7f46b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/39d7e7ed16ce662454975c5f2d438b3acb08aaa567ff75320ff5d1b69fc7f46b/json HTTP/1.1" 200 None Executing query create workload B2 in Z settings priority = 1; on node Executing query create workload B2 in Z settings priority = 1; on node http://localhost:None "GET /v1.46/containers/39d7e7ed16ce662454975c5f2d438b3acb08aaa567ff75320ff5d1b69fc7f46b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/39d7e7ed16ce662454975c5f2d438b3acb08aaa567ff75320ff5d1b69fc7f46b/json HTTP/1.1" 200 None Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance http://localhost:None "GET /v1.46/containers/39d7e7ed16ce662454975c5f2d438b3acb08aaa567ff75320ff5d1b69fc7f46b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/39d7e7ed16ce662454975c5f2d438b3acb08aaa567ff75320ff5d1b69fc7f46b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/39d7e7ed16ce662454975c5f2d438b3acb08aaa567ff75320ff5d1b69fc7f46b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/39d7e7ed16ce662454975c5f2d438b3acb08aaa567ff75320ff5d1b69fc7f46b/json HTTP/1.1" 200 None Executing query create workload B3 in Z settings priority = 1; on node Executing query create workload B3 in Z settings priority = 1; on node http://localhost:None "GET /v1.46/containers/39d7e7ed16ce662454975c5f2d438b3acb08aaa567ff75320ff5d1b69fc7f46b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/39d7e7ed16ce662454975c5f2d438b3acb08aaa567ff75320ff5d1b69fc7f46b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/39d7e7ed16ce662454975c5f2d438b3acb08aaa567ff75320ff5d1b69fc7f46b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/39d7e7ed16ce662454975c5f2d438b3acb08aaa567ff75320ff5d1b69fc7f46b/json HTTP/1.1" 200 None run container_id:roottests3imdssimple-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token failed, falling back to a less secure way" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] run container_id:roottests3imdssimple-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token failed, falling back to a less secure way" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] Command:[docker exec roottests3imdssimple-gw6-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token failed, falling back to a less secure way" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker exec roottests3imdssimple-gw6-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token failed, falling back to a less secure way" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query create workload C1 in X settings priority = -1; on node Executing query create workload C1 in X settings priority = -1; on node Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:13.510330 [ 9 ] {677f2340-0336-4edb-b58e-46f6ea90874c} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token failed, falling back to a less secure way. HTTP response code: NOT_IMPLEMENTED Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:13.510330 [ 9 ] {677f2340-0336-4edb-b58e-46f6ea90874c} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token failed, falling back to a less secure way. HTTP response code: NOT_IMPLEMENTED Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:13.838104 [ 9 ] {67a79221-cf51-43c2-977b-d1f2d680fc62} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token failed, falling back to a less secure way. HTTP response code: NOT_IMPLEMENTED Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:13.838104 [ 9 ] {67a79221-cf51-43c2-977b-d1f2d680fc62} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token failed, falling back to a less secure way. HTTP response code: NOT_IMPLEMENTED run container_id:roottests3imdssimple-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Getting default credentials for ec2 instance from resolver:8080" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] run container_id:roottests3imdssimple-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Getting default credentials for ec2 instance from resolver:8080" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] Command:[docker exec roottests3imdssimple-gw6-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Getting default credentials for ec2 instance from resolver:8080" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker exec roottests3imdssimple-gw6-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Getting default credentials for ec2 instance from resolver:8080" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] http://localhost:None "GET /v1.46/containers/39d7e7ed16ce662454975c5f2d438b3acb08aaa567ff75320ff5d1b69fc7f46b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/39d7e7ed16ce662454975c5f2d438b3acb08aaa567ff75320ff5d1b69fc7f46b/json HTTP/1.1" 200 None Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:13.510370 [ 9 ] {677f2340-0336-4edb-b58e-46f6ea90874c} AWSEC2InstanceProfileConfigLoader: Getting default credentials for ec2 instance from resolver:8080 Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:13.510370 [ 9 ] {677f2340-0336-4edb-b58e-46f6ea90874c} AWSEC2InstanceProfileConfigLoader: Getting default credentials for ec2 instance from resolver:8080 Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:13.838158 [ 9 ] {67a79221-cf51-43c2-977b-d1f2d680fc62} AWSEC2InstanceProfileConfigLoader: Getting default credentials for ec2 instance from resolver:8080 Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:13.838158 [ 9 ] {67a79221-cf51-43c2-977b-d1f2d680fc62} AWSEC2InstanceProfileConfigLoader: Getting default credentials for ec2 instance from resolver:8080 run container_id:roottests3imdssimple-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials returned credential string myrole" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] run container_id:roottests3imdssimple-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials returned credential string myrole" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] Command:[docker exec roottests3imdssimple-gw6-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials returned credential string myrole" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker exec roottests3imdssimple-gw6-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials returned credential string myrole" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:13.511206 [ 9 ] {677f2340-0336-4edb-b58e-46f6ea90874c} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials returned credential string myrole. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:13.511206 [ 9 ] {677f2340-0336-4edb-b58e-46f6ea90874c} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials returned credential string myrole. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:13.838913 [ 9 ] {67a79221-cf51-43c2-977b-d1f2d680fc62} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials returned credential string myrole. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:13.838913 [ 9 ] {67a79221-cf51-43c2-977b-d1f2d680fc62} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials returned credential string myrole. run container_id:roottests3imdssimple-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource /latest/meta-data/iam/security-credentials/myrole" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] run container_id:roottests3imdssimple-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource /latest/meta-data/iam/security-credentials/myrole" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] Command:[docker exec roottests3imdssimple-gw6-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource /latest/meta-data/iam/security-credentials/myrole" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker exec roottests3imdssimple-gw6-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource /latest/meta-data/iam/security-credentials/myrole" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] http://localhost:None "GET /v1.46/containers/39d7e7ed16ce662454975c5f2d438b3acb08aaa567ff75320ff5d1b69fc7f46b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/39d7e7ed16ce662454975c5f2d438b3acb08aaa567ff75320ff5d1b69fc7f46b/json HTTP/1.1" 200 None ClickHouse node1 started ClickHouse node1 started get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw7-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw7-node2-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw7-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw7-node2-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node2, ip: 172.16.2.6... Waiting for ClickHouse start in node2, ip: 172.16.2.6... http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw7-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw7-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3f5dd76052d22d4fbd13801d434726cdb15a181c349b8556b227ef8047135f12/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/3f5dd76052d22d4fbd13801d434726cdb15a181c349b8556b227ef8047135f12/json HTTP/1.1" 200 None ClickHouse node2 started ClickHouse node2 started Executing query CREATE DATABASE test ENGINE = Ordinary on node1 Executing query CREATE DATABASE test ENGINE = Ordinary on node1 Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:13.511267 [ 9 ] {677f2340-0336-4edb-b58e-46f6ea90874c} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource /latest/meta-data/iam/security-credentials/myrole. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:13.511267 [ 9 ] {677f2340-0336-4edb-b58e-46f6ea90874c} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource /latest/meta-data/iam/security-credentials/myrole. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:13.838986 [ 9 ] {67a79221-cf51-43c2-977b-d1f2d680fc62} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource /latest/meta-data/iam/security-credentials/myrole. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:13.838986 [ 9 ] {67a79221-cf51-43c2-977b-d1f2d680fc62} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource /latest/meta-data/iam/security-credentials/myrole. run container_id:roottests3imdssimple-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] run container_id:roottests3imdssimple-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] Command:[docker exec roottests3imdssimple-gw6-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker exec roottests3imdssimple-gw6-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Executing query create workload C2 in X settings priority = -1; on node Executing query create workload C2 in X settings priority = -1; on node Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:13.512400 [ 9 ] {677f2340-0336-4edb-b58e-46f6ea90874c} AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:13.512400 [ 9 ] {677f2340-0336-4edb-b58e-46f6ea90874c} AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:13.839675 [ 9 ] {67a79221-cf51-43c2-977b-d1f2d680fc62} AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:13.839675 [ 9 ] {67a79221-cf51-43c2-977b-d1f2d680fc62} AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key. Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env --project-name roottests3imdssimple-gw6 --file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] [gw6] PASSED test_s3_imds/test_simple.py::test_credentials_from_metadata Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env --project-name roottests3imdssimple-gw6 --file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance Executing query CREATE TABLE test.table ( a UInt32, b String DEFAULT If(a = 0, 'true', 'false'), c String DEFAULT Cast(a, 'String') ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/test/table', 'node1') ORDER BY a on node1 Executing query CREATE TABLE test.table ( a UInt32, b String DEFAULT If(a = 0, 'true', 'false'), c String DEFAULT Cast(a, 'String') ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/test/table', 'node1') ORDER BY a on node1 Executing query create workload C3 in X settings priority = -1; on node Executing query create workload C3 in X settings priority = -1; on node Connection dropped: outstanding heartbeat ping not received Connection dropped: outstanding heartbeat ping not received Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query select * from `postgres_database`.`postgresql_replica_1` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_1` order by key; on instance Executing query create workload D1 in X settings priority = 1; on node Executing query create workload D1 in X settings priority = 1; on node Executing query CREATE DATABASE test ENGINE = Ordinary on node2 Executing query CREATE DATABASE test ENGINE = Ordinary on node2 Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Executing query create workload D2 in X settings priority = 1; on node Executing query create workload D2 in X settings priority = 1; on node Executing query CREATE TABLE test.table ( a UInt32, b String DEFAULT If(a = 0, 'true', 'false'), c String DEFAULT Cast(a, 'String') ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/test/table', 'node2') ORDER BY a on node2 Executing query CREATE TABLE test.table ( a UInt32, b String DEFAULT If(a = 0, 'true', 'false'), c String DEFAULT Cast(a, 'String') ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/test/table', 'node2') ORDER BY a on node2 Executing query create workload D3 in X settings priority = 1; on node Executing query create workload D3 in X settings priority = 1; on node Executing query select * from `test_database`.`postgresql_replica_1` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_1` order by key; on instance Executing query DETACH TABLE test.table on node1 Executing query DETACH TABLE test.table on node1 Executing query drop workload A1; on node Executing query drop workload A1; on node Executing query SYSTEM DROP REPLICA 'node1' FROM TABLE test.table on node2 Executing query SYSTEM DROP REPLICA 'node1' FROM TABLE test.table on node2 Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Executing query drop workload B1; on node Executing query drop workload B1; on node run container_id:roottestreplicatedmergetreecompatibility-gw7-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'rm /var/lib/clickhouse/metadata/test/table.sql'] run container_id:roottestreplicatedmergetreecompatibility-gw7-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'rm /var/lib/clickhouse/metadata/test/table.sql'] Command:[docker exec roottestreplicatedmergetreecompatibility-gw7-node1-1 bash -c rm /var/lib/clickhouse/metadata/test/table.sql] Command:[docker exec roottestreplicatedmergetreecompatibility-gw7-node1-1 bash -c rm /var/lib/clickhouse/metadata/test/table.sql] run container_id:roottestreplicatedmergetreecompatibility-gw7-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'rm -r /var/lib/clickhouse/data/test/table'] run container_id:roottestreplicatedmergetreecompatibility-gw7-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'rm -r /var/lib/clickhouse/data/test/table'] Command:[docker exec roottestreplicatedmergetreecompatibility-gw7-node1-1 bash -c rm -r /var/lib/clickhouse/data/test/table] Command:[docker exec roottestreplicatedmergetreecompatibility-gw7-node1-1 bash -c rm -r /var/lib/clickhouse/data/test/table] get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw7-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreecompatibility-gw7-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.2.4, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.2.4, port:2181, use_ssl:False Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): Exists(path='/clickhouse/tables/test/table/replicas/node1', watcher=None) Sending request(xid=1): Exists(path='/clickhouse/tables/test/table/replicas/node1', watcher=None) run container_id:roottestreplicatedmergetreecompatibility-gw7-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill -15 clickhouse'] run container_id:roottestreplicatedmergetreecompatibility-gw7-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill -15 clickhouse'] Command:[docker exec -u root roottestreplicatedmergetreecompatibility-gw7-node1-1 bash -c pkill -15 clickhouse] Command:[docker exec -u root roottestreplicatedmergetreecompatibility-gw7-node1-1 bash -c pkill -15 clickhouse] run container_id:roottestreplicatedmergetreecompatibility-gw7-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicatedmergetreecompatibility-gw7-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicatedmergetreecompatibility-gw7-node1-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicatedmergetreecompatibility-gw7-node1-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query drop workload C1; on node Executing query drop workload C1; on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance Stdout:8 Stdout:8 Executing query drop workload D1; on node Executing query drop workload D1; on node Executing query select * from `postgres_database`.`postgresql_replica_2` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_2` order by key; on instance Executing query drop workload A2; on node Executing query drop workload A2; on node run container_id:roottestreplicatedmergetreecompatibility-gw7-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicatedmergetreecompatibility-gw7-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicatedmergetreecompatibility-gw7-node1-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicatedmergetreecompatibility-gw7-node1-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestreplicatedmergetreecompatibility-gw7-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicatedmergetreecompatibility-gw7-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicatedmergetreecompatibility-gw7-node1-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicatedmergetreecompatibility-gw7-node1-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestreplicatedmergetreecompatibility-gw7-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /usr/bin/clickhouse /usr/share/clickhouse_original'] run container_id:roottestreplicatedmergetreecompatibility-gw7-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /usr/bin/clickhouse /usr/share/clickhouse_original'] Command:[docker exec -u root roottestreplicatedmergetreecompatibility-gw7-node1-1 bash -c cp /usr/bin/clickhouse /usr/share/clickhouse_original] Command:[docker exec -u root roottestreplicatedmergetreecompatibility-gw7-node1-1 bash -c cp /usr/bin/clickhouse /usr/share/clickhouse_original] Executing query drop workload B2; on node Executing query drop workload B2; on node Executing query select * from `test_database`.`postgresql_replica_2` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_2` order by key; on instance run container_id:roottestreplicatedmergetreecompatibility-gw7-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /usr/share/clickhouse_fresh /usr/bin/clickhouse && chmod 777 /usr/bin/clickhouse'] run container_id:roottestreplicatedmergetreecompatibility-gw7-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /usr/share/clickhouse_fresh /usr/bin/clickhouse && chmod 777 /usr/bin/clickhouse'] Command:[docker exec -u root roottestreplicatedmergetreecompatibility-gw7-node1-1 bash -c cp /usr/share/clickhouse_fresh /usr/bin/clickhouse && chmod 777 /usr/bin/clickhouse] Command:[docker exec -u root roottestreplicatedmergetreecompatibility-gw7-node1-1 bash -c cp /usr/share/clickhouse_fresh /usr/bin/clickhouse && chmod 777 /usr/bin/clickhouse] Executing query create resource io_test (write disk non_existent_disk, read disk non_existent_disk); on node Executing query create resource io_test (write disk non_existent_disk, read disk non_existent_disk); on node Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Executing query drop resource io_test; on node Executing query drop resource io_test; on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Executing query drop workload C2; on node Executing query drop workload C2; on node Executing query drop workload D2; on node Executing query drop workload D2; on node Executing query select * from `postgres_database`.`postgresql_replica_3` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_3` order by key; on instance Executing query drop workload A3; on node Executing query drop workload A3; on node Executing query drop workload B3; on node Executing query drop workload B3; on node Executing query select * from `test_database`.`postgresql_replica_3` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_3` order by key; on instance Executing query drop workload C3; on node Executing query drop workload C3; on node Executing query drop workload D3; on node Executing query drop workload D3; on node Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query drop workload X; on node Executing query drop workload X; on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance Connection dropped: socket connection error: No route to host Connection dropped: socket connection error: No route to host Executing query drop workload Y; on node Executing query drop workload Y; on node Executing query select * from `postgres_database`.`postgresql_replica_4` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_4` order by key; on instance Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Executing query drop workload Z; on node Executing query drop workload Z; on node Executing query drop workload all; on node Executing query drop workload all; on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query select * from `test_database`.`postgresql_replica_4` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_4` order by key; on instance Executing query create workload all; on node Executing query create workload all; on node run container_id:roottestreplicatedmergetreecompatibility-gw7-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "echo 'restart_with_latest_version: From version' && /usr/share/clickhouse_original server --version && echo 'To version' /usr/share/clickhouse_fresh server --version"] run container_id:roottestreplicatedmergetreecompatibility-gw7-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "echo 'restart_with_latest_version: From version' && /usr/share/clickhouse_original server --version && echo 'To version' /usr/share/clickhouse_fresh server --version"] Command:[docker exec roottestreplicatedmergetreecompatibility-gw7-node1-1 bash -c echo 'restart_with_latest_version: From version' && /usr/share/clickhouse_original server --version && echo 'To version' /usr/share/clickhouse_fresh server --version] Command:[docker exec roottestreplicatedmergetreecompatibility-gw7-node1-1 bash -c echo 'restart_with_latest_version: From version' && /usr/share/clickhouse_original server --version && echo 'To version' /usr/share/clickhouse_fresh server --version] Executing query create workload X in all settings priority = 0; on node Executing query create workload X in all settings priority = 0; on node Stdout:restart_with_latest_version: From version Stdout:restart_with_latest_version: From version Stdout:ClickHouse server version 23.3.22.3 (official build). Stdout:ClickHouse server version 23.3.22.3 (official build). Stdout:To version /usr/share/clickhouse_fresh server --version Stdout:To version /usr/share/clickhouse_fresh server --version run container_id:roottestreplicatedmergetreecompatibility-gw7-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- '] run container_id:roottestreplicatedmergetreecompatibility-gw7-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- '] Command:[docker exec -u 0 roottestreplicatedmergetreecompatibility-gw7-node1-1 bash -c clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ] Command:[docker exec -u 0 roottestreplicatedmergetreecompatibility-gw7-node1-1 bash -c clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ] Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance [gw0] PASSED test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished run container_id:roottestreplicatedmergetreecompatibility-gw7-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicatedmergetreecompatibility-gw7-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicatedmergetreecompatibility-gw7-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicatedmergetreecompatibility-gw7-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query create workload Y in all settings priority = 1; on node Executing query create workload Y in all settings priority = 1; on node Stdout:365 Stdout:365 Executing query select 20 on node1 Executing query select 20 on node1 Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query create workload A1 in X settings priority = -1; on node Executing query create workload A1 in X settings priority = -1; on node Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query create workload B1 in X settings priority = 1; on node Executing query create workload B1 in X settings priority = 1; on node Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query create workload C1 in Y settings priority = -1; on node Executing query create workload C1 in Y settings priority = -1; on node Executing query select 20 on node1 Executing query select 20 on node1 test_postgresql_replica_database_engine_1/test.py::test_single_transaction Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query create workload D1 in Y settings priority = 1; on node Executing query create workload D1 in Y settings priority = 1; on node Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query create workload A2 in X settings priority = -1; on node Executing query create workload A2 in X settings priority = -1; on node Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance Executing query create workload B2 in X settings priority = 1; on node Executing query create workload B2 in X settings priority = 1; on node Executing query select 20 on node1 Executing query select 20 on node1 Executing query create workload C2 in Y settings priority = -1; on node Executing query create workload C2 in Y settings priority = -1; on node Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query create workload D2 in Y settings priority = 1; on node Executing query create workload D2 in Y settings priority = 1; on node Stderr: Container roottestreplicatedparsezkmetadata-gw3-node-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw3-node-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw3-node-1 Stopped Stderr: Container roottestreplicatedparsezkmetadata-gw3-node-1 Stopped Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo2-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo2-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo3-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo3-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo1-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo1-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo2-1 Stopped Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo2-1 Stopped Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo3-1 Stopped Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo3-1 Stopped Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo1-1 Stopped Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo1-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/.env --project-name roottestreplicatedparsezkmetadata-gw3 --file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/.env --project-name roottestreplicatedparsezkmetadata-gw3 --file /ClickHouse/tests/integration/test_replicated_parse_zk_metadata/_instances-0-gw3/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml down --volumes] Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: proxy1 Pulling Stderr: proxy1 Pulling Stderr: minio1 Pulling Stderr: minio1 Pulling Stderr: node Pulling Stderr: node Pulling Stderr: resolver Pulling Stderr: resolver Pulling Stderr: resolver Pulled Stderr: resolver Pulled Stderr: proxy1 Pulled Stderr: proxy1 Pulled Stderr: node Pulled Stderr: node Pulled Stderr: minio1 Pulled Stderr: minio1 Pulled Trying to create Minio instance by command docker compose --project-name roottests3storageclass-gw5 --env-file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Trying to create Minio instance by command docker compose --project-name roottests3storageclass-gw5 --env-file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Command:[docker compose --project-name roottests3storageclass-gw5 --env-file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Command:[docker compose --project-name roottests3storageclass-gw5 --env-file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Executing query drop workload A1; on node Executing query drop workload A1; on node Executing query select 20 on node1 Executing query select 20 on node1 Executing query drop workload A2; on node Executing query drop workload A2; on node Executing query drop workload B1; on node Executing query drop workload B1; on node Stderr: Container roottestreplicatedparsezkmetadata-gw3-node-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw3-node-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw3-node-1 Stopped Stderr: Container roottestreplicatedparsezkmetadata-gw3-node-1 Stopped Stderr: Container roottestreplicatedparsezkmetadata-gw3-node-1 Removing Stderr: Container roottestreplicatedparsezkmetadata-gw3-node-1 Removing Stderr: Container roottestreplicatedparsezkmetadata-gw3-node-1 Removed Stderr: Container roottestreplicatedparsezkmetadata-gw3-node-1 Removed Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo1-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo1-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo2-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo2-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo3-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo3-1 Stopping Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo2-1 Stopped Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo2-1 Stopped Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo2-1 Removing Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo2-1 Removing Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo1-1 Stopped Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo1-1 Stopped Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo1-1 Removing Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo1-1 Removing Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo3-1 Stopped Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo3-1 Stopped Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo3-1 Removing Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo3-1 Removing Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo1-1 Removed Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo1-1 Removed Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo3-1 Removed Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo3-1 Removed Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo2-1 Removed Stderr: Container roottestreplicatedparsezkmetadata-gw3-zoo2-1 Removed Stderr: Network roottestreplicatedparsezkmetadata-gw3_default Removing Stderr: Network roottestreplicatedparsezkmetadata-gw3_default Removing Stderr: Network roottestreplicatedparsezkmetadata-gw3_default Removed Stderr: Network roottestreplicatedparsezkmetadata-gw3_default Removed Cleanup called Cleanup called Docker networks for project roottestreplicatedparsezkmetadata-gw3 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedparsezkmetadata-gw3 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicatedparsezkmetadata-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedparsezkmetadata-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicatedparsezkmetadata-gw3 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedparsezkmetadata-gw3 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreplicatedparsezkmetadata-gw3-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreplicatedparsezkmetadata-gw3-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicatedparsezkmetadata-gw3 No running containers for project: roottestreplicatedparsezkmetadata-gw3 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:9 Stdout:9 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 9 Volumes pruned: 9 test_s3_imds/test_session_token.py::test_credentials_from_metadata Running tests in /ClickHouse/tests/integration/test_s3_imds/test_session_token.py Running tests in /ClickHouse/tests/integration/test_s3_imds/test_session_token.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottests3imdssessiontoken-gw3 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3imdssessiontoken-gw3 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3imdssessiontoken-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3imdssessiontoken-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3imdssessiontoken-gw3 are DRIVER VOLUME NAME Docker volumes for project roottests3imdssessiontoken-gw3 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottests3imdssessiontoken-gw3 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3imdssessiontoken-gw3 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3imdssessiontoken-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3imdssessiontoken-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Executing query drop workload B2; on node Executing query drop workload B2; on node Docker volumes for project roottests3imdssessiontoken-gw3 are DRIVER VOLUME NAME Docker volumes for project roottests3imdssessiontoken-gw3 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3imdssessiontoken-gw3-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3imdssessiontoken-gw3-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3imdssessiontoken-gw3 No running containers for project: roottests3imdssessiontoken-gw3 Trying to prune unused networks... Trying to prune unused networks... Executing query select 20 on node1 Executing query select 20 on node1 Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:11 Stdout:11 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 11 Volumes pruned: 11 Setup directory for instance: node Setup directory for instance: node Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_s3_imds/configs/use_environment_credentials.xml'] to /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/node/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_s3_imds/configs/use_environment_credentials.xml'] to /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/node/configs/config.d Setup database dir /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/node/database Setup database dir /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/node/database Setup logs dir /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/node/logs Setup logs dir /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/node/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'AWS_EC2_METADATA_SERVICE_ENDPOINT': 'resolver:8080', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'AWS_EC2_METADATA_SERVICE_ENDPOINT': 'resolver:8080', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/.env --project-name roottests3imdssessiontoken-gw3 --file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/.env --project-name roottests3imdssessiontoken-gw3 --file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Executing query drop workload C1; on node Executing query drop workload C1; on node run container_id:roottestreplicatedmergetreecompatibility-gw7-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill -15 clickhouse'] run container_id:roottestreplicatedmergetreecompatibility-gw7-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill -15 clickhouse'] Command:[docker exec -u root roottestreplicatedmergetreecompatibility-gw7-node2-1 bash -c pkill -15 clickhouse] Command:[docker exec -u root roottestreplicatedmergetreecompatibility-gw7-node2-1 bash -c pkill -15 clickhouse] run container_id:roottestreplicatedmergetreecompatibility-gw7-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicatedmergetreecompatibility-gw7-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicatedmergetreecompatibility-gw7-node2-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicatedmergetreecompatibility-gw7-node2-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8 Stdout:8 Stderr:time="2025-04-02T02:56:22Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:56:22Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottests3storageclass-gw5_default Creating Stderr: Network roottests3storageclass-gw5_default Creating Stderr: Network roottests3storageclass-gw5_default Created Stderr: Network roottests3storageclass-gw5_default Created Stderr: Volume "roottests3storageclass-gw5_data1-1" Creating Stderr: Volume "roottests3storageclass-gw5_data1-1" Creating Stderr: Volume "roottests3storageclass-gw5_data1-1" Created Stderr: Volume "roottests3storageclass-gw5_data1-1" Created Stderr: Container roottests3storageclass-gw5-proxy2-1 Creating Stderr: Container roottests3storageclass-gw5-proxy2-1 Creating Stderr: Container roottests3storageclass-gw5-proxy1-1 Creating Stderr: Container roottests3storageclass-gw5-proxy1-1 Creating Stderr: Container roottests3storageclass-gw5-proxy2-1 Created Stderr: Container roottests3storageclass-gw5-proxy2-1 Created Stderr: Container roottests3storageclass-gw5-proxy1-1 Created Stderr: Container roottests3storageclass-gw5-proxy1-1 Created Stderr: Container roottests3storageclass-gw5-minio1-1 Creating Stderr: Container roottests3storageclass-gw5-minio1-1 Creating Stderr: Container roottests3storageclass-gw5-resolver-1 Creating Stderr: Container roottests3storageclass-gw5-resolver-1 Creating Stderr: Container roottests3storageclass-gw5-resolver-1 Created Stderr: Container roottests3storageclass-gw5-resolver-1 Created Stderr: Container roottests3storageclass-gw5-minio1-1 Created Stderr: Container roottests3storageclass-gw5-minio1-1 Created Stderr: Container roottests3storageclass-gw5-proxy2-1 Starting Stderr: Container roottests3storageclass-gw5-proxy2-1 Starting Stderr: Container roottests3storageclass-gw5-proxy1-1 Starting Stderr: Container roottests3storageclass-gw5-proxy1-1 Starting Stderr: Container roottests3storageclass-gw5-proxy2-1 Started Stderr: Container roottests3storageclass-gw5-proxy2-1 Started Stderr: Container roottests3storageclass-gw5-proxy1-1 Started Stderr: Container roottests3storageclass-gw5-proxy1-1 Started Stderr: Container roottests3storageclass-gw5-minio1-1 Starting Stderr: Container roottests3storageclass-gw5-minio1-1 Starting Stderr: Container roottests3storageclass-gw5-resolver-1 Starting Stderr: Container roottests3storageclass-gw5-resolver-1 Starting Stderr: Container roottests3storageclass-gw5-resolver-1 Started Stderr: Container roottests3storageclass-gw5-resolver-1 Started Stderr: Container roottests3storageclass-gw5-minio1-1 Started Stderr: Container roottests3storageclass-gw5-minio1-1 Started Stderr:time="2025-04-02T02:56:24Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:56:24Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:56:24Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:56:24Z" level=debug msg="otel error" error="" Trying to connect to Minio... Trying to connect to Minio... get_instance_ip instance_name=minio1 get_instance_ip instance_name=minio1 http://localhost:None "GET /v1.46/containers/roottests3storageclass-gw5-minio1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageclass-gw5-minio1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy1 get_instance_ip instance_name=proxy1 http://localhost:None "GET /v1.46/containers/roottests3storageclass-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageclass-gw5-proxy1-1/json HTTP/1.1" 200 None Starting new HTTP connection (1): 172.16.3.4:9001 Starting new HTTP connection (1): 172.16.3.4:9001 Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (2): 172.16.3.4:9001 Starting new HTTP connection (2): 172.16.3.4:9001 Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (3): 172.16.3.4:9001 Starting new HTTP connection (3): 172.16.3.4:9001 Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (4): 172.16.3.4:9001 Starting new HTTP connection (4): 172.16.3.4:9001 Can't connect to Minio: HTTPConnectionPool(host='172.16.3.4', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Can't connect to Minio: HTTPConnectionPool(host='172.16.3.4', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Executing query drop workload C2; on node Executing query drop workload C2; on node run container_id:roottestreplicatedmergetreecompatibility-gw7-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicatedmergetreecompatibility-gw7-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicatedmergetreecompatibility-gw7-node2-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicatedmergetreecompatibility-gw7-node2-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query drop workload D1; on node Executing query drop workload D1; on node Stdout:8 Stdout:8 Executing query drop workload D2; on node Executing query drop workload D2; on node Executing query create workload Z in all; on node Executing query create workload Z in all; on node run container_id:roottestreplicatedmergetreecompatibility-gw7-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicatedmergetreecompatibility-gw7-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicatedmergetreecompatibility-gw7-node2-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicatedmergetreecompatibility-gw7-node2-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8 Stdout:8 Executing query create workload A1 in Z settings priority = -1; on node Executing query create workload A1 in Z settings priority = -1; on node Starting new HTTP connection (5): 172.16.3.4:9001 Starting new HTTP connection (5): 172.16.3.4:9001 http://172.16.3.4:9001 "GET / HTTP/1.1" 200 0 http://172.16.3.4:9001 "GET / HTTP/1.1" 200 0 Connected to Minio. Connected to Minio. http://172.16.3.4:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.3.4:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.3.4:9001 "PUT /root HTTP/1.1" 200 0 http://172.16.3.4:9001 "PUT /root HTTP/1.1" 200 0 S3 bucket 'root' created S3 bucket 'root' created http://172.16.3.4:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.3.4:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.3.4:9001 "PUT /root2 HTTP/1.1" 200 0 http://172.16.3.4:9001 "PUT /root2 HTTP/1.1" 200 0 S3 bucket 'root2' created S3 bucket 'root2' created ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/.env --project-name roottests3storageclass-gw5 --file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/.env --project-name roottests3storageclass-gw5 --file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/.env --project-name roottests3storageclass-gw5 --file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/.env --project-name roottests3storageclass-gw5 --file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Executing query create workload A2 in Z settings priority = -1; on node Executing query create workload A2 in Z settings priority = -1; on node Stderr: Container roottests3storageclass-gw5-proxy2-1 Running Stderr: Container roottests3storageclass-gw5-proxy2-1 Running Stderr: Container roottests3storageclass-gw5-proxy1-1 Running Stderr: Container roottests3storageclass-gw5-proxy1-1 Running Stderr: Container roottests3storageclass-gw5-resolver-1 Running Stderr: Container roottests3storageclass-gw5-resolver-1 Running Stderr: Container roottests3storageclass-gw5-minio1-1 Running Stderr: Container roottests3storageclass-gw5-minio1-1 Running Stderr: Container roottests3storageclass-gw5-node-1 Creating Stderr: Container roottests3storageclass-gw5-node-1 Creating Stderr: Container roottests3storageclass-gw5-node-1 Created Stderr: Container roottests3storageclass-gw5-node-1 Created Stderr: Container roottests3storageclass-gw5-node-1 Starting Stderr: Container roottests3storageclass-gw5-node-1 Starting Stderr: Container roottests3storageclass-gw5-node-1 Started Stderr: Container roottests3storageclass-gw5-node-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottests3storageclass-gw5-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageclass-gw5-node-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottests3storageclass-gw5-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageclass-gw5-node-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node, ip: 172.16.3.6... Waiting for ClickHouse start in node, ip: 172.16.3.6... http://localhost:None "GET /v1.46/containers/roottests3storageclass-gw5-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageclass-gw5-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None Executing query create workload A3 in Z settings priority = -1; on node Executing query create workload A3 in Z settings priority = -1; on node run container_id:roottestreplicatedmergetreecompatibility-gw7-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicatedmergetreecompatibility-gw7-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicatedmergetreecompatibility-gw7-node2-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicatedmergetreecompatibility-gw7-node2-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestreplicatedmergetreecompatibility-gw7-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicatedmergetreecompatibility-gw7-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicatedmergetreecompatibility-gw7-node2-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicatedmergetreecompatibility-gw7-node2-1 bash -c ps ax | grep 'clickhouse server' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None run container_id:roottestreplicatedmergetreecompatibility-gw7-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /usr/bin/clickhouse /usr/share/clickhouse_original'] run container_id:roottestreplicatedmergetreecompatibility-gw7-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /usr/bin/clickhouse /usr/share/clickhouse_original'] Command:[docker exec -u root roottestreplicatedmergetreecompatibility-gw7-node2-1 bash -c cp /usr/bin/clickhouse /usr/share/clickhouse_original] Command:[docker exec -u root roottestreplicatedmergetreecompatibility-gw7-node2-1 bash -c cp /usr/bin/clickhouse /usr/share/clickhouse_original] http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None Executing query create workload B1 in Z settings priority = 1; on node Executing query create workload B1 in Z settings priority = 1; on node http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None run container_id:roottestreplicatedmergetreecompatibility-gw7-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /usr/share/clickhouse_fresh /usr/bin/clickhouse && chmod 777 /usr/bin/clickhouse'] run container_id:roottestreplicatedmergetreecompatibility-gw7-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'cp /usr/share/clickhouse_fresh /usr/bin/clickhouse && chmod 777 /usr/bin/clickhouse'] Command:[docker exec -u root roottestreplicatedmergetreecompatibility-gw7-node2-1 bash -c cp /usr/share/clickhouse_fresh /usr/bin/clickhouse && chmod 777 /usr/bin/clickhouse] Command:[docker exec -u root roottestreplicatedmergetreecompatibility-gw7-node2-1 bash -c cp /usr/share/clickhouse_fresh /usr/bin/clickhouse && chmod 777 /usr/bin/clickhouse] Executing query create workload B2 in Z settings priority = 1; on node Executing query create workload B2 in Z settings priority = 1; on node http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None Executing query create workload B3 in Z settings priority = 1; on node Executing query create workload B3 in Z settings priority = 1; on node http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None Executing query create workload C1 in X settings priority = -1; on node Executing query create workload C1 in X settings priority = -1; on node http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None Executing query create workload C2 in X settings priority = -1; on node Executing query create workload C2 in X settings priority = -1; on node http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None Executing query create workload C3 in X settings priority = -1; on node Executing query create workload C3 in X settings priority = -1; on node http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None Executing query create workload D1 in X settings priority = 1; on node Executing query create workload D1 in X settings priority = 1; on node http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None Executing query create workload D2 in X settings priority = 1; on node Executing query create workload D2 in X settings priority = 1; on node http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None Executing query create workload D3 in X settings priority = 1; on node Executing query create workload D3 in X settings priority = 1; on node http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query drop workload A1; on node Executing query drop workload A1; on node http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/16246f85ee653047d7ada03bdf2db159b19262103c50b4100637d8508405fe89/json HTTP/1.1" 200 None ClickHouse node started ClickHouse node started Executing query CREATE TABLE test_s3_storage_class ( `id` UInt64, `value` String ) ENGINE = MergeTree ORDER BY id SETTINGS storage_policy='use_s3_storage_class'; on node Executing query CREATE TABLE test_s3_storage_class ( `id` UInt64, `value` String ) ENGINE = MergeTree ORDER BY id SETTINGS storage_policy='use_s3_storage_class'; on node Executing query drop workload B1; on node Executing query drop workload B1; on node Executing query INSERT INTO test_s3_storage_class VALUES (1, 'a'); on node Executing query INSERT INTO test_s3_storage_class VALUES (1, 'a'); on node Executing query drop workload C1; on node Executing query drop workload C1; on node Executing query SELECT id FROM test_s3_storage_class; on node Executing query SELECT id FROM test_s3_storage_class; on node Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query drop workload D1; on node Executing query drop workload D1; on node run container_id:roottestreplicatedmergetreecompatibility-gw7-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "echo 'restart_with_latest_version: From version' && /usr/share/clickhouse_original server --version && echo 'To version' /usr/share/clickhouse_fresh server --version"] run container_id:roottestreplicatedmergetreecompatibility-gw7-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "echo 'restart_with_latest_version: From version' && /usr/share/clickhouse_original server --version && echo 'To version' /usr/share/clickhouse_fresh server --version"] Command:[docker exec roottestreplicatedmergetreecompatibility-gw7-node2-1 bash -c echo 'restart_with_latest_version: From version' && /usr/share/clickhouse_original server --version && echo 'To version' /usr/share/clickhouse_fresh server --version] Command:[docker exec roottestreplicatedmergetreecompatibility-gw7-node2-1 bash -c echo 'restart_with_latest_version: From version' && /usr/share/clickhouse_original server --version && echo 'To version' /usr/share/clickhouse_fresh server --version] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/.env --project-name roottests3storageclass-gw5 --file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/.env --project-name roottests3storageclass-gw5 --file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] [gw5] PASSED test_s3_storage_class/test.py::test_s3_storage_class_right Stdout:restart_with_latest_version: From version Stdout:restart_with_latest_version: From version Stdout:ClickHouse server version 23.3.22.3 (official build). Stdout:ClickHouse server version 23.3.22.3 (official build). Stdout:To version /usr/share/clickhouse_fresh server --version Stdout:To version /usr/share/clickhouse_fresh server --version run container_id:roottestreplicatedmergetreecompatibility-gw7-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- '] run container_id:roottestreplicatedmergetreecompatibility-gw7-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- '] Command:[docker exec -u 0 roottestreplicatedmergetreecompatibility-gw7-node2-1 bash -c clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ] Command:[docker exec -u 0 roottestreplicatedmergetreecompatibility-gw7-node2-1 bash -c clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ] Executing query drop workload A2; on node Executing query drop workload A2; on node run container_id:roottestreplicatedmergetreecompatibility-gw7-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestreplicatedmergetreecompatibility-gw7-node2-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestreplicatedmergetreecompatibility-gw7-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestreplicatedmergetreecompatibility-gw7-node2-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Executing query select count() from test_database.postgresql_replica_0 on instance Executing query select count() from test_database.postgresql_replica_0 on instance Stdout:378 Stdout:378 Executing query select 20 on node2 Executing query select 20 on node2 Executing query create resource io_test (write disk non_existent_disk, read disk non_existent_disk); on node Executing query create resource io_test (write disk non_existent_disk, read disk non_existent_disk); on node Executing query drop resource io_test; on node Executing query drop resource io_test; on node Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query drop workload B2; on node Executing query drop workload B2; on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query select 20 on node2 Executing query select 20 on node2 Executing query drop workload C2; on node Executing query drop workload C2; on node Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Executing query drop workload D2; on node Executing query drop workload D2; on node Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query drop workload A3; on node Executing query drop workload A3; on node Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select 20 on node2 Executing query select 20 on node2 Executing query drop workload B3; on node Executing query drop workload B3; on node Executing query drop workload C3; on node Executing query drop workload C3; on node Executing query drop workload D3; on node Executing query drop workload D3; on node Executing query drop workload X; on node Executing query drop workload X; on node Executing query select 20 on node2 Executing query select 20 on node2 Executing query drop workload Y; on node Executing query drop workload Y; on node Executing query drop workload Z; on node Executing query drop workload Z; on node Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query drop workload all; on node Executing query drop workload all; on node Executing query select 20 on node2 Executing query select 20 on node2 Executing query create workload all; on node Executing query create workload all; on node Executing query CREATE TABLE test.table ( a UInt32, b String DEFAULT If(a = 0, 'true', 'false'), c String DEFAULT Cast(a, 'String') ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/test/table', '1') ORDER BY a on node1 Executing query CREATE TABLE test.table ( a UInt32, b String DEFAULT If(a = 0, 'true', 'false'), c String DEFAULT Cast(a, 'String') ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/test/table', '1') ORDER BY a on node1 Executing query create workload X in all settings priority = 0; on node Executing query create workload X in all settings priority = 0; on node Executing query EXISTS TABLE test.table on node1 Executing query EXISTS TABLE test.table on node1 Executing query create workload Y in all settings priority = 1; on node Executing query create workload Y in all settings priority = 1; on node Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/.env --project-name roottestreplicatedmergetreecompatibility-gw7 --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node2/docker-compose.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/.env --project-name roottestreplicatedmergetreecompatibility-gw7 --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node2/docker-compose.yml stop --timeout 20] [gw7] PASSED test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility Executing query create workload A1 in X settings priority = -1; on node Executing query create workload A1 in X settings priority = -1; on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query create workload B1 in X settings priority = 1; on node Executing query create workload B1 in X settings priority = 1; on node Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query create workload C1 in Y settings priority = -1; on node Executing query create workload C1 in Y settings priority = -1; on node Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query create workload D1 in Y settings priority = 1; on node Executing query create workload D1 in Y settings priority = 1; on node Executing query create workload A2 in X settings priority = -1; on node Executing query create workload A2 in X settings priority = -1; on node Executing query create workload B2 in X settings priority = 1; on node Executing query create workload B2 in X settings priority = 1; on node Executing query create workload C2 in Y settings priority = -1; on node Executing query create workload C2 in Y settings priority = -1; on node Executing query create workload D2 in Y settings priority = 1; on node Executing query create workload D2 in Y settings priority = 1; on node Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query drop workload A1; on node Executing query drop workload A1; on node Executing query drop workload A2; on node Executing query drop workload A2; on node Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: minio1 Pulling Stderr: minio1 Pulling Stderr: proxy1 Pulling Stderr: proxy1 Pulling Stderr: node Pulling Stderr: node Pulling Stderr: resolver Pulling Stderr: resolver Pulling Stderr: resolver Pulled Stderr: resolver Pulled Stderr: node Pulled Stderr: node Pulled Stderr: proxy1 Pulled Stderr: proxy1 Pulled Stderr: minio1 Pulled Stderr: minio1 Pulled Trying to create Minio instance by command docker compose --project-name roottests3imdssessiontoken-gw3 --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Trying to create Minio instance by command docker compose --project-name roottests3imdssessiontoken-gw3 --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Command:[docker compose --project-name roottests3imdssessiontoken-gw3 --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Command:[docker compose --project-name roottests3imdssessiontoken-gw3 --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Executing query drop workload B1; on node Executing query drop workload B1; on node Executing query drop workload B2; on node Executing query drop workload B2; on node Executing query drop workload C1; on node Executing query drop workload C1; on node Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Stderr:time="2025-04-02T02:56:34Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:56:34Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottests3imdssessiontoken-gw3_default Creating Stderr: Network roottests3imdssessiontoken-gw3_default Creating Stderr: Network roottests3imdssessiontoken-gw3_default Created Stderr: Network roottests3imdssessiontoken-gw3_default Created Stderr: Volume "roottests3imdssessiontoken-gw3_data1-1" Creating Stderr: Volume "roottests3imdssessiontoken-gw3_data1-1" Creating Stderr: Volume "roottests3imdssessiontoken-gw3_data1-1" Created Stderr: Volume "roottests3imdssessiontoken-gw3_data1-1" Created Stderr: Container roottests3imdssessiontoken-gw3-proxy1-1 Creating Stderr: Container roottests3imdssessiontoken-gw3-proxy1-1 Creating Stderr: Container roottests3imdssessiontoken-gw3-proxy2-1 Creating Stderr: Container roottests3imdssessiontoken-gw3-proxy2-1 Creating Stderr: Container roottests3imdssessiontoken-gw3-proxy1-1 Created Stderr: Container roottests3imdssessiontoken-gw3-proxy1-1 Created Stderr: Container roottests3imdssessiontoken-gw3-proxy2-1 Created Stderr: Container roottests3imdssessiontoken-gw3-proxy2-1 Created Stderr: Container roottests3imdssessiontoken-gw3-resolver-1 Creating Stderr: Container roottests3imdssessiontoken-gw3-resolver-1 Creating Stderr: Container roottests3imdssessiontoken-gw3-minio1-1 Creating Stderr: Container roottests3imdssessiontoken-gw3-minio1-1 Creating Stderr: Container roottests3imdssessiontoken-gw3-resolver-1 Created Stderr: Container roottests3imdssessiontoken-gw3-resolver-1 Created Stderr: Container roottests3imdssessiontoken-gw3-minio1-1 Created Stderr: Container roottests3imdssessiontoken-gw3-minio1-1 Created Stderr: Container roottests3imdssessiontoken-gw3-proxy1-1 Starting Stderr: Container roottests3imdssessiontoken-gw3-proxy1-1 Starting Stderr: Container roottests3imdssessiontoken-gw3-proxy2-1 Starting Stderr: Container roottests3imdssessiontoken-gw3-proxy2-1 Starting Stderr: Container roottests3imdssessiontoken-gw3-proxy1-1 Started Stderr: Container roottests3imdssessiontoken-gw3-proxy1-1 Started Stderr: Container roottests3imdssessiontoken-gw3-proxy2-1 Started Stderr: Container roottests3imdssessiontoken-gw3-proxy2-1 Started Stderr: Container roottests3imdssessiontoken-gw3-resolver-1 Starting Stderr: Container roottests3imdssessiontoken-gw3-resolver-1 Starting Stderr: Container roottests3imdssessiontoken-gw3-minio1-1 Starting Stderr: Container roottests3imdssessiontoken-gw3-minio1-1 Starting Stderr: Container roottests3imdssessiontoken-gw3-resolver-1 Started Stderr: Container roottests3imdssessiontoken-gw3-resolver-1 Started Stderr: Container roottests3imdssessiontoken-gw3-minio1-1 Started Stderr: Container roottests3imdssessiontoken-gw3-minio1-1 Started Stderr:time="2025-04-02T02:56:35Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:56:35Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:56:35Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:56:35Z" level=debug msg="otel error" error="" Trying to connect to Minio... Trying to connect to Minio... get_instance_ip instance_name=minio1 get_instance_ip instance_name=minio1 http://localhost:None "GET /v1.46/containers/roottests3imdssessiontoken-gw3-minio1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3imdssessiontoken-gw3-minio1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy1 get_instance_ip instance_name=proxy1 http://localhost:None "GET /v1.46/containers/roottests3imdssessiontoken-gw3-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3imdssessiontoken-gw3-proxy1-1/json HTTP/1.1" 200 None Starting new HTTP connection (1): 172.16.5.5:9001 Starting new HTTP connection (1): 172.16.5.5:9001 Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (2): 172.16.5.5:9001 Starting new HTTP connection (2): 172.16.5.5:9001 Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (3): 172.16.5.5:9001 Starting new HTTP connection (3): 172.16.5.5:9001 Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (4): 172.16.5.5:9001 Starting new HTTP connection (4): 172.16.5.5:9001 Can't connect to Minio: HTTPConnectionPool(host='172.16.5.5', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Can't connect to Minio: HTTPConnectionPool(host='172.16.5.5', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Executing query drop workload C2; on node Executing query drop workload C2; on node Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance [gw0] PASSED test_postgresql_replica_database_engine_1/test.py::test_single_transaction Executing query drop workload D1; on node Executing query drop workload D1; on node Executing query drop workload D2; on node Executing query drop workload D2; on node Stderr: Container roottests3imdssimple-gw6-node-1 Stopping Stderr: Container roottests3imdssimple-gw6-node-1 Stopping Stderr: Container roottests3imdssimple-gw6-resolver-1 Stopping Stderr: Container roottests3imdssimple-gw6-resolver-1 Stopping Stderr: Container roottests3imdssimple-gw6-node-1 Stopped Stderr: Container roottests3imdssimple-gw6-node-1 Stopped Stderr: Container roottests3imdssimple-gw6-minio1-1 Stopping Stderr: Container roottests3imdssimple-gw6-minio1-1 Stopping Stderr: Container roottests3imdssimple-gw6-minio1-1 Stopped Stderr: Container roottests3imdssimple-gw6-minio1-1 Stopped Stderr: Container roottests3imdssimple-gw6-resolver-1 Stopped Stderr: Container roottests3imdssimple-gw6-resolver-1 Stopped Stderr: Container roottests3imdssimple-gw6-proxy1-1 Stopping Stderr: Container roottests3imdssimple-gw6-proxy1-1 Stopping Stderr: Container roottests3imdssimple-gw6-proxy2-1 Stopping Stderr: Container roottests3imdssimple-gw6-proxy2-1 Stopping Stderr: Container roottests3imdssimple-gw6-proxy1-1 Stopped Stderr: Container roottests3imdssimple-gw6-proxy1-1 Stopped Stderr: Container roottests3imdssimple-gw6-proxy2-1 Stopped Stderr: Container roottests3imdssimple-gw6-proxy2-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env --project-name roottests3imdssimple-gw6 --file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/.env --project-name roottests3imdssimple-gw6 --file /ClickHouse/tests/integration/test_s3_imds/_instances-simple-0-gw6/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query create workload Z in all; on node Executing query create workload Z in all; on node Starting new HTTP connection (5): 172.16.5.5:9001 Starting new HTTP connection (5): 172.16.5.5:9001 http://172.16.5.5:9001 "GET / HTTP/1.1" 200 0 http://172.16.5.5:9001 "GET / HTTP/1.1" 200 0 Connected to Minio. Connected to Minio. http://172.16.5.5:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.5.5:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.5.5:9001 "PUT /root HTTP/1.1" 200 0 http://172.16.5.5:9001 "PUT /root HTTP/1.1" 200 0 S3 bucket 'root' created S3 bucket 'root' created http://172.16.5.5:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.5.5:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.5.5:9001 "PUT /root2 HTTP/1.1" 200 0 http://172.16.5.5:9001 "PUT /root2 HTTP/1.1" 200 0 S3 bucket 'root2' created S3 bucket 'root2' created ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/.env --project-name roottests3imdssessiontoken-gw3 --file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/.env --project-name roottests3imdssessiontoken-gw3 --file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/.env --project-name roottests3imdssessiontoken-gw3 --file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/.env --project-name roottests3imdssessiontoken-gw3 --file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Executing query create workload A1 in Z settings priority = -1; on node Executing query create workload A1 in Z settings priority = -1; on node Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query create workload A2 in Z settings priority = -1; on node Executing query create workload A2 in Z settings priority = -1; on node Stderr: Container roottests3imdssimple-gw6-node-1 Stopping Stderr: Container roottests3imdssimple-gw6-node-1 Stopping Stderr: Container roottests3imdssimple-gw6-resolver-1 Stopping Stderr: Container roottests3imdssimple-gw6-resolver-1 Stopping Stderr: Container roottests3imdssimple-gw6-node-1 Stopped Stderr: Container roottests3imdssimple-gw6-node-1 Stopped Stderr: Container roottests3imdssimple-gw6-node-1 Removing Stderr: Container roottests3imdssimple-gw6-node-1 Removing Stderr: Container roottests3imdssimple-gw6-resolver-1 Stopped Stderr: Container roottests3imdssimple-gw6-resolver-1 Stopped Stderr: Container roottests3imdssimple-gw6-resolver-1 Removing Stderr: Container roottests3imdssimple-gw6-resolver-1 Removing Stderr: Container roottests3imdssimple-gw6-node-1 Removed Stderr: Container roottests3imdssimple-gw6-node-1 Removed Stderr: Container roottests3imdssimple-gw6-minio1-1 Stopping Stderr: Container roottests3imdssimple-gw6-minio1-1 Stopping Stderr: Container roottests3imdssimple-gw6-minio1-1 Stopped Stderr: Container roottests3imdssimple-gw6-minio1-1 Stopped Stderr: Container roottests3imdssimple-gw6-minio1-1 Removing Stderr: Container roottests3imdssimple-gw6-minio1-1 Removing Stderr: Container roottests3imdssimple-gw6-resolver-1 Removed Stderr: Container roottests3imdssimple-gw6-resolver-1 Removed Stderr: Container roottests3imdssimple-gw6-minio1-1 Removed Stderr: Container roottests3imdssimple-gw6-minio1-1 Removed Stderr: Container roottests3imdssimple-gw6-proxy1-1 Stopping Stderr: Container roottests3imdssimple-gw6-proxy1-1 Stopping Stderr: Container roottests3imdssimple-gw6-proxy2-1 Stopping Stderr: Container roottests3imdssimple-gw6-proxy2-1 Stopping Stderr: Container roottests3imdssimple-gw6-proxy1-1 Stopped Stderr: Container roottests3imdssimple-gw6-proxy1-1 Stopped Stderr: Container roottests3imdssimple-gw6-proxy1-1 Removing Stderr: Container roottests3imdssimple-gw6-proxy1-1 Removing Stderr: Container roottests3imdssimple-gw6-proxy2-1 Stopped Stderr: Container roottests3imdssimple-gw6-proxy2-1 Stopped Stderr: Container roottests3imdssimple-gw6-proxy2-1 Removing Stderr: Container roottests3imdssimple-gw6-proxy2-1 Removing Stderr: Container roottests3imdssimple-gw6-proxy1-1 Removed Stderr: Container roottests3imdssimple-gw6-proxy1-1 Removed Stderr: Container roottests3imdssimple-gw6-proxy2-1 Removed Stderr: Container roottests3imdssimple-gw6-proxy2-1 Removed Stderr: Volume roottests3imdssimple-gw6_data1-1 Removing Stderr: Volume roottests3imdssimple-gw6_data1-1 Removing Stderr: Network roottests3imdssimple-gw6_default Removing Stderr: Network roottests3imdssimple-gw6_default Removing Stderr: Volume roottests3imdssimple-gw6_data1-1 Removed Stderr: Volume roottests3imdssimple-gw6_data1-1 Removed Stderr: Network roottests3imdssimple-gw6_default Removed Stderr: Network roottests3imdssimple-gw6_default Removed Cleanup called Cleanup called Docker networks for project roottests3imdssimple-gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3imdssimple-gw6 are NETWORK ID NAME DRIVER SCOPE Stderr: Container roottests3imdssessiontoken-gw3-proxy2-1 Running Stderr: Container roottests3imdssessiontoken-gw3-proxy2-1 Running Stderr: Container roottests3imdssessiontoken-gw3-proxy1-1 Running Stderr: Container roottests3imdssessiontoken-gw3-proxy1-1 Running Stderr: Container roottests3imdssessiontoken-gw3-minio1-1 Running Stderr: Container roottests3imdssessiontoken-gw3-minio1-1 Running Stderr: Container roottests3imdssessiontoken-gw3-resolver-1 Running Stderr: Container roottests3imdssessiontoken-gw3-resolver-1 Running Stderr: Container roottests3imdssessiontoken-gw3-node-1 Creating Stderr: Container roottests3imdssessiontoken-gw3-node-1 Creating Stderr: Container roottests3imdssessiontoken-gw3-node-1 Created Stderr: Container roottests3imdssessiontoken-gw3-node-1 Created Stderr: Container roottests3imdssessiontoken-gw3-node-1 Starting Stderr: Container roottests3imdssessiontoken-gw3-node-1 Starting Stderr: Container roottests3imdssessiontoken-gw3-node-1 Started Stderr: Container roottests3imdssessiontoken-gw3-node-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottests3imdssessiontoken-gw3-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3imdssessiontoken-gw3-node-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottests3imdssessiontoken-gw3-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3imdssessiontoken-gw3-node-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node, ip: 172.16.5.6... Waiting for ClickHouse start in node, ip: 172.16.5.6... http://localhost:None "GET /v1.46/containers/roottests3imdssessiontoken-gw3-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3imdssessiontoken-gw3-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None Docker containers for project roottests3imdssimple-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3imdssimple-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3imdssimple-gw6 are DRIVER VOLUME NAME Docker volumes for project roottests3imdssimple-gw6 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3imdssimple-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3imdssimple-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3imdssimple-gw6 No running containers for project: roottests3imdssimple-gw6 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:11 Stdout:11 Command:[docker volume prune -f] Command:[docker volume prune -f] http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 11 Volumes pruned: 11 Executing query create workload A3 in Z settings priority = -1; on node Executing query create workload A3 in Z settings priority = -1; on node http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes Executing query INSERT INTO postgres_database.postgresql_replica_0 SELECT number, 0, 0, 0 from numbers(25) on instance Executing query INSERT INTO postgres_database.postgresql_replica_0 SELECT number, 0, 0, 0 from numbers(25) on instance http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None Executing query create workload B1 in Z settings priority = 1; on node Executing query create workload B1 in Z settings priority = 1; on node http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.postgresql_replica_1 SELECT number, 1, 1, 1 from numbers(25) on instance Executing query INSERT INTO postgres_database.postgresql_replica_1 SELECT number, 1, 1, 1 from numbers(25) on instance Executing query create workload B2 in Z settings priority = 1; on node Executing query create workload B2 in Z settings priority = 1; on node http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None Executing query create workload B3 in Z settings priority = 1; on node Executing query create workload B3 in Z settings priority = 1; on node http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.postgresql_replica_2 SELECT number, 2, 2, 2 from numbers(25) on instance Executing query INSERT INTO postgres_database.postgresql_replica_2 SELECT number, 2, 2, 2 from numbers(25) on instance http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None Executing query create workload C1 in X settings priority = -1; on node Executing query create workload C1 in X settings priority = -1; on node http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.postgresql_replica_3 SELECT number, 3, 3, 3 from numbers(25) on instance Executing query INSERT INTO postgres_database.postgresql_replica_3 SELECT number, 3, 3, 3 from numbers(25) on instance http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None Executing query create workload C2 in X settings priority = -1; on node Executing query create workload C2 in X settings priority = -1; on node http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None Executing query INSERT INTO postgres_database.postgresql_replica_4 SELECT number, 4, 4, 4 from numbers(25) on instance Executing query INSERT INTO postgres_database.postgresql_replica_4 SELECT number, 4, 4, 4 from numbers(25) on instance http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None Executing query create workload C3 in X settings priority = -1; on node Executing query create workload C3 in X settings priority = -1; on node http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None Executing query create workload D1 in X settings priority = 1; on node Executing query create workload D1 in X settings priority = 1; on node Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None Executing query create workload D2 in X settings priority = 1; on node Executing query create workload D2 in X settings priority = 1; on node Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None Executing query create resource io_test (write disk non_existent_disk, read disk non_existent_disk); on node Executing query create resource io_test (write disk non_existent_disk, read disk non_existent_disk); on node http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/260036d105ceaaa6767b8e070fad1abc3ac7e973c0bbed70cf9cff0519f1a514/json HTTP/1.1" 200 None ClickHouse node started ClickHouse node started Starting mock server server_with_session_tokens.py Starting mock server server_with_session_tokens.py run container_id:roottests3imdssessiontoken-gw3-resolver-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname server_with_session_tokens.py) && echo aW1wb3J0IGh0dHAuc2VydmVyCmltcG9ydCBzeXMKaW1wb3J0IHV1aWQKCiMgU2Vzc2lvbiB0b2tlbnMgZm9yIElNRFMgc2Vzc2lvbnMuCnRva2VucyA9IHNldCgpCgoKZGVmIG5ld190b2tlbigpOgogICAgdG9rZW4gPSBzdHIodXVpZC51dWlkNCgpKQogICAgZ2xvYmFsIHRva2VucwogICAgdG9rZW5zLmFkZCh0b2tlbikKICAgIHJldHVybiB0b2tlbgoKCmRlZiB0b2tlbl9leGlzdHModG9rZW4pOgogICAgZ2xvYmFsIHRva2VucwogICAgcmV0dXJuIHRva2VuIGluIHRva2VucwoKCmNsYXNzIFJlcXVlc3RIYW5kbGVyKGh0dHAuc2VydmVyLkJhc2VIVFRQUmVxdWVzdEhhbmRsZXIpOgogICAgZGVmIGdldF9yZXNwb25zZShzZWxmKToKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi8iOgogICAgICAgICAgICByZXR1cm4gIk9LIiwgMjAwCgogICAgICAgIGlmIHNlbGYucGF0aCA9PSAiL2xhdGVzdC9hcGkvdG9rZW4iOgogICAgICAgICAgICByZXR1cm4gbmV3X3Rva2VuKCksIDIwMAoKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi9sYXRlc3QvbWV0YS1kYXRhL2lhbS9zZWN1cml0eS1jcmVkZW50aWFscyI6CiAgICAgICAgICAgIGlmIHRva2VuX2V4aXN0cyhzZWxmLmhlYWRlcnMuZ2V0KCJ4LWF3cy1lYzItbWV0YWRhdGEtdG9rZW4iKSk6CiAgICAgICAgICAgICAgICByZXR1cm4gIm15cm9sZSIsIDIwMAoKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi9sYXRlc3QvbWV0YS1kYXRhL2lhbS9zZWN1cml0eS1jcmVkZW50aWFscy9teXJvbGUiOgogICAgICAgICAgICBpZiB0b2tlbl9leGlzdHMoc2VsZi5oZWFkZXJzLmdldCgieC1hd3MtZWMyLW1ldGFkYXRhLXRva2VuIikpOgogICAgICAgICAgICAgICAgcmV0dXJuICgKICAgICAgICAgICAgICAgICAgICAneyAiQ29kZSIgOiAiU3VjY2VzcyIsICJUeXBlIiA6ICJBV1MtSE1BQyIsICJBY2Nlc3NLZXlJZCIgOiAibWluaW8iLCAiU2VjcmV0QWNjZXNzS2V5IiA6ICJtaW5pbzEyMyIgfScsCiAgICAgICAgICAgICAgICAgICAgMjAwLAogICAgICAgICAgICAgICAgKQoKICAgICAgICBpZiBzZWxmLnBhdGguc3RhcnRzd2l0aCgiL2xhdGVzdC9tZXRhLWRhdGEvaWFtL3NlY3VyaXR5LWNyZWRlbnRpYWxzIik6CiAgICAgICAgICAgIHJldHVybiAiIiwgNDAxICAjIFVua25vd24gdG9rZW4gb3Igbm90IHNwZWNpZmllZC4KCiAgICAgICAgIyBSZXNvdXJjZSBub3QgZm91bmQuCiAgICAgICAgcmV0dXJuICIiLCA0MDQKCiAgICBkZWYgZG9fSEVBRChzZWxmKToKICAgICAgICByZXNwb25zZSwgY29kZSA9IHNlbGYuZ2V0X3Jlc3BvbnNlKCkKICAgICAgICBzZWxmLnNlbmRfcmVzcG9uc2UoY29kZSkKICAgICAgICBzZWxmLnNlbmRfaGVhZGVyKCJDb250ZW50LVR5cGUiLCAidGV4dC9wbGFpbiIpCiAgICAgICAgc2VsZi5zZW5kX2hlYWRlcigiQ29udGVudC1MZW5ndGgiLCBsZW4ocmVzcG9uc2UuZW5jb2RlKCkpKQogICAgICAgIHNlbGYuZW5kX2hlYWRlcnMoKQogICAgICAgIHJldHVybiByZXNwb25zZSwgY29kZQoKICAgIGRlZiBkb19HRVQoc2VsZik6CiAgICAgICAgcmVzcG9uc2UsIF8gPSBzZWxmLmRvX0hFQUQoKQogICAgICAgIHNlbGYud2ZpbGUud3JpdGUocmVzcG9uc2UuZW5jb2RlKCkpCgogICAgZGVmIGRvX1BVVChzZWxmKToKICAgICAgICBzZWxmLmRvX0dFVCgpCgoKaHR0cGQgPSBodHRwLnNlcnZlci5IVFRQU2VydmVyKCgiMC4wLjAuMCIsIGludChzeXMuYXJndlsxXSkpLCBSZXF1ZXN0SGFuZGxlcikKaHR0cGQuc2VydmVfZm9yZXZlcigpCg== | base64 --decode > server_with_session_tokens.py'] run container_id:roottests3imdssessiontoken-gw3-resolver-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname server_with_session_tokens.py) && echo aW1wb3J0IGh0dHAuc2VydmVyCmltcG9ydCBzeXMKaW1wb3J0IHV1aWQKCiMgU2Vzc2lvbiB0b2tlbnMgZm9yIElNRFMgc2Vzc2lvbnMuCnRva2VucyA9IHNldCgpCgoKZGVmIG5ld190b2tlbigpOgogICAgdG9rZW4gPSBzdHIodXVpZC51dWlkNCgpKQogICAgZ2xvYmFsIHRva2VucwogICAgdG9rZW5zLmFkZCh0b2tlbikKICAgIHJldHVybiB0b2tlbgoKCmRlZiB0b2tlbl9leGlzdHModG9rZW4pOgogICAgZ2xvYmFsIHRva2VucwogICAgcmV0dXJuIHRva2VuIGluIHRva2VucwoKCmNsYXNzIFJlcXVlc3RIYW5kbGVyKGh0dHAuc2VydmVyLkJhc2VIVFRQUmVxdWVzdEhhbmRsZXIpOgogICAgZGVmIGdldF9yZXNwb25zZShzZWxmKToKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi8iOgogICAgICAgICAgICByZXR1cm4gIk9LIiwgMjAwCgogICAgICAgIGlmIHNlbGYucGF0aCA9PSAiL2xhdGVzdC9hcGkvdG9rZW4iOgogICAgICAgICAgICByZXR1cm4gbmV3X3Rva2VuKCksIDIwMAoKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi9sYXRlc3QvbWV0YS1kYXRhL2lhbS9zZWN1cml0eS1jcmVkZW50aWFscyI6CiAgICAgICAgICAgIGlmIHRva2VuX2V4aXN0cyhzZWxmLmhlYWRlcnMuZ2V0KCJ4LWF3cy1lYzItbWV0YWRhdGEtdG9rZW4iKSk6CiAgICAgICAgICAgICAgICByZXR1cm4gIm15cm9sZSIsIDIwMAoKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi9sYXRlc3QvbWV0YS1kYXRhL2lhbS9zZWN1cml0eS1jcmVkZW50aWFscy9teXJvbGUiOgogICAgICAgICAgICBpZiB0b2tlbl9leGlzdHMoc2VsZi5oZWFkZXJzLmdldCgieC1hd3MtZWMyLW1ldGFkYXRhLXRva2VuIikpOgogICAgICAgICAgICAgICAgcmV0dXJuICgKICAgICAgICAgICAgICAgICAgICAneyAiQ29kZSIgOiAiU3VjY2VzcyIsICJUeXBlIiA6ICJBV1MtSE1BQyIsICJBY2Nlc3NLZXlJZCIgOiAibWluaW8iLCAiU2VjcmV0QWNjZXNzS2V5IiA6ICJtaW5pbzEyMyIgfScsCiAgICAgICAgICAgICAgICAgICAgMjAwLAogICAgICAgICAgICAgICAgKQoKICAgICAgICBpZiBzZWxmLnBhdGguc3RhcnRzd2l0aCgiL2xhdGVzdC9tZXRhLWRhdGEvaWFtL3NlY3VyaXR5LWNyZWRlbnRpYWxzIik6CiAgICAgICAgICAgIHJldHVybiAiIiwgNDAxICAjIFVua25vd24gdG9rZW4gb3Igbm90IHNwZWNpZmllZC4KCiAgICAgICAgIyBSZXNvdXJjZSBub3QgZm91bmQuCiAgICAgICAgcmV0dXJuICIiLCA0MDQKCiAgICBkZWYgZG9fSEVBRChzZWxmKToKICAgICAgICByZXNwb25zZSwgY29kZSA9IHNlbGYuZ2V0X3Jlc3BvbnNlKCkKICAgICAgICBzZWxmLnNlbmRfcmVzcG9uc2UoY29kZSkKICAgICAgICBzZWxmLnNlbmRfaGVhZGVyKCJDb250ZW50LVR5cGUiLCAidGV4dC9wbGFpbiIpCiAgICAgICAgc2VsZi5zZW5kX2hlYWRlcigiQ29udGVudC1MZW5ndGgiLCBsZW4ocmVzcG9uc2UuZW5jb2RlKCkpKQogICAgICAgIHNlbGYuZW5kX2hlYWRlcnMoKQogICAgICAgIHJldHVybiByZXNwb25zZSwgY29kZQoKICAgIGRlZiBkb19HRVQoc2VsZik6CiAgICAgICAgcmVzcG9uc2UsIF8gPSBzZWxmLmRvX0hFQUQoKQogICAgICAgIHNlbGYud2ZpbGUud3JpdGUocmVzcG9uc2UuZW5jb2RlKCkpCgogICAgZGVmIGRvX1BVVChzZWxmKToKICAgICAgICBzZWxmLmRvX0dFVCgpCgoKaHR0cGQgPSBodHRwLnNlcnZlci5IVFRQU2VydmVyKCgiMC4wLjAuMCIsIGludChzeXMuYXJndlsxXSkpLCBSZXF1ZXN0SGFuZGxlcikKaHR0cGQuc2VydmVfZm9yZXZlcigpCg== | base64 --decode > server_with_session_tokens.py'] Command:[docker exec roottests3imdssessiontoken-gw3-resolver-1 bash -c mkdir -p $(dirname server_with_session_tokens.py) && echo aW1wb3J0IGh0dHAuc2VydmVyCmltcG9ydCBzeXMKaW1wb3J0IHV1aWQKCiMgU2Vzc2lvbiB0b2tlbnMgZm9yIElNRFMgc2Vzc2lvbnMuCnRva2VucyA9IHNldCgpCgoKZGVmIG5ld190b2tlbigpOgogICAgdG9rZW4gPSBzdHIodXVpZC51dWlkNCgpKQogICAgZ2xvYmFsIHRva2VucwogICAgdG9rZW5zLmFkZCh0b2tlbikKICAgIHJldHVybiB0b2tlbgoKCmRlZiB0b2tlbl9leGlzdHModG9rZW4pOgogICAgZ2xvYmFsIHRva2VucwogICAgcmV0dXJuIHRva2VuIGluIHRva2VucwoKCmNsYXNzIFJlcXVlc3RIYW5kbGVyKGh0dHAuc2VydmVyLkJhc2VIVFRQUmVxdWVzdEhhbmRsZXIpOgogICAgZGVmIGdldF9yZXNwb25zZShzZWxmKToKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi8iOgogICAgICAgICAgICByZXR1cm4gIk9LIiwgMjAwCgogICAgICAgIGlmIHNlbGYucGF0aCA9PSAiL2xhdGVzdC9hcGkvdG9rZW4iOgogICAgICAgICAgICByZXR1cm4gbmV3X3Rva2VuKCksIDIwMAoKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi9sYXRlc3QvbWV0YS1kYXRhL2lhbS9zZWN1cml0eS1jcmVkZW50aWFscyI6CiAgICAgICAgICAgIGlmIHRva2VuX2V4aXN0cyhzZWxmLmhlYWRlcnMuZ2V0KCJ4LWF3cy1lYzItbWV0YWRhdGEtdG9rZW4iKSk6CiAgICAgICAgICAgICAgICByZXR1cm4gIm15cm9sZSIsIDIwMAoKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi9sYXRlc3QvbWV0YS1kYXRhL2lhbS9zZWN1cml0eS1jcmVkZW50aWFscy9teXJvbGUiOgogICAgICAgICAgICBpZiB0b2tlbl9leGlzdHMoc2VsZi5oZWFkZXJzLmdldCgieC1hd3MtZWMyLW1ldGFkYXRhLXRva2VuIikpOgogICAgICAgICAgICAgICAgcmV0dXJuICgKICAgICAgICAgICAgICAgICAgICAneyAiQ29kZSIgOiAiU3VjY2VzcyIsICJUeXBlIiA6ICJBV1MtSE1BQyIsICJBY2Nlc3NLZXlJZCIgOiAibWluaW8iLCAiU2VjcmV0QWNjZXNzS2V5IiA6ICJtaW5pbzEyMyIgfScsCiAgICAgICAgICAgICAgICAgICAgMjAwLAogICAgICAgICAgICAgICAgKQoKICAgICAgICBpZiBzZWxmLnBhdGguc3RhcnRzd2l0aCgiL2xhdGVzdC9tZXRhLWRhdGEvaWFtL3NlY3VyaXR5LWNyZWRlbnRpYWxzIik6CiAgICAgICAgICAgIHJldHVybiAiIiwgNDAxICAjIFVua25vd24gdG9rZW4gb3Igbm90IHNwZWNpZmllZC4KCiAgICAgICAgIyBSZXNvdXJjZSBub3QgZm91bmQuCiAgICAgICAgcmV0dXJuICIiLCA0MDQKCiAgICBkZWYgZG9fSEVBRChzZWxmKToKICAgICAgICByZXNwb25zZSwgY29kZSA9IHNlbGYuZ2V0X3Jlc3BvbnNlKCkKICAgICAgICBzZWxmLnNlbmRfcmVzcG9uc2UoY29kZSkKICAgICAgICBzZWxmLnNlbmRfaGVhZGVyKCJDb250ZW50LVR5cGUiLCAidGV4dC9wbGFpbiIpCiAgICAgICAgc2VsZi5zZW5kX2hlYWRlcigiQ29udGVudC1MZW5ndGgiLCBsZW4ocmVzcG9uc2UuZW5jb2RlKCkpKQogICAgICAgIHNlbGYuZW5kX2hlYWRlcnMoKQogICAgICAgIHJldHVybiByZXNwb25zZSwgY29kZQoKICAgIGRlZiBkb19HRVQoc2VsZik6CiAgICAgICAgcmVzcG9uc2UsIF8gPSBzZWxmLmRvX0hFQUQoKQogICAgICAgIHNlbGYud2ZpbGUud3JpdGUocmVzcG9uc2UuZW5jb2RlKCkpCgogICAgZGVmIGRvX1BVVChzZWxmKToKICAgICAgICBzZWxmLmRvX0dFVCgpCgoKaHR0cGQgPSBodHRwLnNlcnZlci5IVFRQU2VydmVyKCgiMC4wLjAuMCIsIGludChzeXMuYXJndlsxXSkpLCBSZXF1ZXN0SGFuZGxlcikKaHR0cGQuc2VydmVfZm9yZXZlcigpCg== | base64 --decode > server_with_session_tokens.py] Command:[docker exec roottests3imdssessiontoken-gw3-resolver-1 bash -c mkdir -p $(dirname server_with_session_tokens.py) && echo aW1wb3J0IGh0dHAuc2VydmVyCmltcG9ydCBzeXMKaW1wb3J0IHV1aWQKCiMgU2Vzc2lvbiB0b2tlbnMgZm9yIElNRFMgc2Vzc2lvbnMuCnRva2VucyA9IHNldCgpCgoKZGVmIG5ld190b2tlbigpOgogICAgdG9rZW4gPSBzdHIodXVpZC51dWlkNCgpKQogICAgZ2xvYmFsIHRva2VucwogICAgdG9rZW5zLmFkZCh0b2tlbikKICAgIHJldHVybiB0b2tlbgoKCmRlZiB0b2tlbl9leGlzdHModG9rZW4pOgogICAgZ2xvYmFsIHRva2VucwogICAgcmV0dXJuIHRva2VuIGluIHRva2VucwoKCmNsYXNzIFJlcXVlc3RIYW5kbGVyKGh0dHAuc2VydmVyLkJhc2VIVFRQUmVxdWVzdEhhbmRsZXIpOgogICAgZGVmIGdldF9yZXNwb25zZShzZWxmKToKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi8iOgogICAgICAgICAgICByZXR1cm4gIk9LIiwgMjAwCgogICAgICAgIGlmIHNlbGYucGF0aCA9PSAiL2xhdGVzdC9hcGkvdG9rZW4iOgogICAgICAgICAgICByZXR1cm4gbmV3X3Rva2VuKCksIDIwMAoKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi9sYXRlc3QvbWV0YS1kYXRhL2lhbS9zZWN1cml0eS1jcmVkZW50aWFscyI6CiAgICAgICAgICAgIGlmIHRva2VuX2V4aXN0cyhzZWxmLmhlYWRlcnMuZ2V0KCJ4LWF3cy1lYzItbWV0YWRhdGEtdG9rZW4iKSk6CiAgICAgICAgICAgICAgICByZXR1cm4gIm15cm9sZSIsIDIwMAoKICAgICAgICBpZiBzZWxmLnBhdGggPT0gIi9sYXRlc3QvbWV0YS1kYXRhL2lhbS9zZWN1cml0eS1jcmVkZW50aWFscy9teXJvbGUiOgogICAgICAgICAgICBpZiB0b2tlbl9leGlzdHMoc2VsZi5oZWFkZXJzLmdldCgieC1hd3MtZWMyLW1ldGFkYXRhLXRva2VuIikpOgogICAgICAgICAgICAgICAgcmV0dXJuICgKICAgICAgICAgICAgICAgICAgICAneyAiQ29kZSIgOiAiU3VjY2VzcyIsICJUeXBlIiA6ICJBV1MtSE1BQyIsICJBY2Nlc3NLZXlJZCIgOiAibWluaW8iLCAiU2VjcmV0QWNjZXNzS2V5IiA6ICJtaW5pbzEyMyIgfScsCiAgICAgICAgICAgICAgICAgICAgMjAwLAogICAgICAgICAgICAgICAgKQoKICAgICAgICBpZiBzZWxmLnBhdGguc3RhcnRzd2l0aCgiL2xhdGVzdC9tZXRhLWRhdGEvaWFtL3NlY3VyaXR5LWNyZWRlbnRpYWxzIik6CiAgICAgICAgICAgIHJldHVybiAiIiwgNDAxICAjIFVua25vd24gdG9rZW4gb3Igbm90IHNwZWNpZmllZC4KCiAgICAgICAgIyBSZXNvdXJjZSBub3QgZm91bmQuCiAgICAgICAgcmV0dXJuICIiLCA0MDQKCiAgICBkZWYgZG9fSEVBRChzZWxmKToKICAgICAgICByZXNwb25zZSwgY29kZSA9IHNlbGYuZ2V0X3Jlc3BvbnNlKCkKICAgICAgICBzZWxmLnNlbmRfcmVzcG9uc2UoY29kZSkKICAgICAgICBzZWxmLnNlbmRfaGVhZGVyKCJDb250ZW50LVR5cGUiLCAidGV4dC9wbGFpbiIpCiAgICAgICAgc2VsZi5zZW5kX2hlYWRlcigiQ29udGVudC1MZW5ndGgiLCBsZW4ocmVzcG9uc2UuZW5jb2RlKCkpKQogICAgICAgIHNlbGYuZW5kX2hlYWRlcnMoKQogICAgICAgIHJldHVybiByZXNwb25zZSwgY29kZQoKICAgIGRlZiBkb19HRVQoc2VsZik6CiAgICAgICAgcmVzcG9uc2UsIF8gPSBzZWxmLmRvX0hFQUQoKQogICAgICAgIHNlbGYud2ZpbGUud3JpdGUocmVzcG9uc2UuZW5jb2RlKCkpCgogICAgZGVmIGRvX1BVVChzZWxmKToKICAgICAgICBzZWxmLmRvX0dFVCgpCgoKaHR0cGQgPSBodHRwLnNlcnZlci5IVFRQU2VydmVyKCgiMC4wLjAuMCIsIGludChzeXMuYXJndlsxXSkpLCBSZXF1ZXN0SGFuZGxlcikKaHR0cGQuc2VydmVfZm9yZXZlcigpCg== | base64 --decode > server_with_session_tokens.py] Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance run container_id:roottests3imdssessiontoken-gw3-resolver-1 detach:True nothrow:False cmd: ['bash', '-c', 'python3 server_with_session_tokens.py 8080 >/var/log/resolver/server_with_session_tokens.log 2>/var/log/resolver/server_with_session_tokens.err.log'] run container_id:roottests3imdssessiontoken-gw3-resolver-1 detach:True nothrow:False cmd: ['bash', '-c', 'python3 server_with_session_tokens.py 8080 >/var/log/resolver/server_with_session_tokens.log 2>/var/log/resolver/server_with_session_tokens.err.log'] Command:[docker exec roottests3imdssessiontoken-gw3-resolver-1 bash -c python3 server_with_session_tokens.py 8080 >/var/log/resolver/server_with_session_tokens.log 2>/var/log/resolver/server_with_session_tokens.err.log] Command:[docker exec roottests3imdssessiontoken-gw3-resolver-1 bash -c python3 server_with_session_tokens.py 8080 >/var/log/resolver/server_with_session_tokens.log 2>/var/log/resolver/server_with_session_tokens.err.log] run container_id:roottests3imdssessiontoken-gw3-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] run container_id:roottests3imdssessiontoken-gw3-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] Command:[docker exec roottests3imdssessiontoken-gw3-resolver-1 curl -s http://localhost:8080/] Command:[docker exec roottests3imdssessiontoken-gw3-resolver-1 curl -s http://localhost:8080/] Exitcode:7 Exitcode:7 Executing query drop resource io_test; on node Executing query drop resource io_test; on node Executing query INSERT INTO postgres_database.postgresql_replica_0 SELECT 25 + number, 0, 0, 0 from numbers(25) on instance Executing query INSERT INTO postgres_database.postgresql_replica_0 SELECT 25 + number, 0, 0, 0 from numbers(25) on instance Executing query create workload D3 in X settings priority = 1; on node Executing query create workload D3 in X settings priority = 1; on node Executing query INSERT INTO postgres_database.postgresql_replica_1 SELECT 25 + number, 1, 1, 1 from numbers(25) on instance Executing query INSERT INTO postgres_database.postgresql_replica_1 SELECT 25 + number, 1, 1, 1 from numbers(25) on instance Executing query drop workload A1; on node Executing query drop workload A1; on node Executing query INSERT INTO postgres_database.postgresql_replica_2 SELECT 25 + number, 2, 2, 2 from numbers(25) on instance Executing query INSERT INTO postgres_database.postgresql_replica_2 SELECT 25 + number, 2, 2, 2 from numbers(25) on instance Executing query drop workload B1; on node Executing query drop workload B1; on node Executing query drop workload C1; on node Executing query drop workload C1; on node Executing query INSERT INTO postgres_database.postgresql_replica_3 SELECT 25 + number, 3, 3, 3 from numbers(25) on instance Executing query INSERT INTO postgres_database.postgresql_replica_3 SELECT 25 + number, 3, 3, 3 from numbers(25) on instance run container_id:roottests3imdssessiontoken-gw3-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] run container_id:roottests3imdssessiontoken-gw3-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] Command:[docker exec roottests3imdssessiontoken-gw3-resolver-1 curl -s http://localhost:8080/] Command:[docker exec roottests3imdssessiontoken-gw3-resolver-1 curl -s http://localhost:8080/] Stdout:OK Stdout:OK server_with_session_tokens.py answered OK on attempt 2 server_with_session_tokens.py answered OK on attempt 2 Mock server server_with_session_tokens.py started Mock server server_with_session_tokens.py started Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/test1.jsonl') SELECT * FROM numbers(100) on node Executing query INSERT INTO FUNCTION s3('http://minio1:9001/root/test1.jsonl') SELECT * FROM numbers(100) on node Executing query drop workload D1; on node Executing query drop workload D1; on node Executing query INSERT INTO postgres_database.postgresql_replica_4 SELECT 25 + number, 4, 4, 4 from numbers(25) on instance Executing query INSERT INTO postgres_database.postgresql_replica_4 SELECT 25 + number, 4, 4, 4 from numbers(25) on instance Executing query drop workload A2; on node Executing query drop workload A2; on node Executing query SELECT count() FROM s3('http://minio1:9001/root/test1.jsonl') on node Executing query SELECT count() FROM s3('http://minio1:9001/root/test1.jsonl') on node Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query drop workload B2; on node Executing query drop workload B2; on node Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Connection dropped: outstanding heartbeat ping not received Connection dropped: outstanding heartbeat ping not received Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Executing query drop workload C2; on node Executing query drop workload C2; on node Executing query SYSTEM FLUSH LOGS on node Executing query SYSTEM FLUSH LOGS on node Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Executing query drop workload D2; on node Executing query drop workload D2; on node Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Executing query drop workload A3; on node Executing query drop workload A3; on node Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query drop workload B3; on node Executing query drop workload B3; on node Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_1` LIMIT 1 FORMAT Null on instance Executing query drop workload C3; on node Executing query drop workload C3; on node run container_id:roottests3imdssessiontoken-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] run container_id:roottests3imdssessiontoken-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] Command:[docker exec roottests3imdssessiontoken-gw3-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker exec roottests3imdssessiontoken-gw3-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:40.419924 [ 9 ] {9e9aa1a6-a52b-4fcc-9db2-d8424be72eeb} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:40.419924 [ 9 ] {9e9aa1a6-a52b-4fcc-9db2-d8424be72eeb} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:40.726465 [ 9 ] {058f1c40-4c62-4623-bce8-3ee07dd653a6} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:40.726465 [ 9 ] {058f1c40-4c62-4623-bce8-3ee07dd653a6} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService to get token. run container_id:roottests3imdssessiontoken-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials with token returned profile string myrole" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] run container_id:roottests3imdssessiontoken-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials with token returned profile string myrole" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] Command:[docker exec roottests3imdssessiontoken-gw3-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials with token returned profile string myrole" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker exec roottests3imdssessiontoken-gw3-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials with token returned profile string myrole" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Executing query drop workload D3; on node Executing query drop workload D3; on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_1' on instance Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:40.422517 [ 9 ] {9e9aa1a6-a52b-4fcc-9db2-d8424be72eeb} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials with token returned profile string myrole. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:40.422517 [ 9 ] {9e9aa1a6-a52b-4fcc-9db2-d8424be72eeb} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials with token returned profile string myrole. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:40.728650 [ 9 ] {058f1c40-4c62-4623-bce8-3ee07dd653a6} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials with token returned profile string myrole. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:40.728650 [ 9 ] {058f1c40-4c62-4623-bce8-3ee07dd653a6} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource, /latest/meta-data/iam/security-credentials with token returned profile string myrole. run container_id:roottests3imdssessiontoken-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource resolver:8080/latest/meta-data/iam/security-credentials/myrole with token" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] run container_id:roottests3imdssessiontoken-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource resolver:8080/latest/meta-data/iam/security-credentials/myrole with token" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] Command:[docker exec roottests3imdssessiontoken-gw3-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource resolver:8080/latest/meta-data/iam/security-credentials/myrole with token" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker exec roottests3imdssessiontoken-gw3-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource resolver:8080/latest/meta-data/iam/security-credentials/myrole with token" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:40.422613 [ 9 ] {9e9aa1a6-a52b-4fcc-9db2-d8424be72eeb} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource resolver:8080/latest/meta-data/iam/security-credentials/myrole with token. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:40.422613 [ 9 ] {9e9aa1a6-a52b-4fcc-9db2-d8424be72eeb} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource resolver:8080/latest/meta-data/iam/security-credentials/myrole with token. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:40.728798 [ 9 ] {058f1c40-4c62-4623-bce8-3ee07dd653a6} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource resolver:8080/latest/meta-data/iam/security-credentials/myrole with token. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:40.728798 [ 9 ] {058f1c40-4c62-4623-bce8-3ee07dd653a6} AWSEC2InstanceProfileConfigLoader: Calling EC2MetadataService resource resolver:8080/latest/meta-data/iam/security-credentials/myrole with token. run container_id:roottests3imdssessiontoken-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] run container_id:roottests3imdssessiontoken-gw3-node-1 detach:False nothrow:False cmd: ['bash', '-c', '[ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true'] Command:[docker exec roottests3imdssessiontoken-gw3-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker exec roottests3imdssessiontoken-gw3-node-1 bash -c [ -f /var/log/clickhouse-server/clickhouse-server.log ] && zgrep -aH "AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key" /var/log/clickhouse-server/clickhouse-server.log | ( [ -z "" ] && cat || grep -v "$" ) || true] Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:40.423264 [ 9 ] {9e9aa1a6-a52b-4fcc-9db2-d8424be72eeb} AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:40.423264 [ 9 ] {9e9aa1a6-a52b-4fcc-9db2-d8424be72eeb} AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:40.729717 [ 9 ] {058f1c40-4c62-4623-bce8-3ee07dd653a6} AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key. Stdout:/var/log/clickhouse-server/clickhouse-server.log:2025.04.02 02:56:40.729717 [ 9 ] {058f1c40-4c62-4623-bce8-3ee07dd653a6} AWSEC2InstanceProfileConfigLoader: Successfully pulled credentials from EC2MetadataService with access key. Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/.env --project-name roottests3imdssessiontoken-gw3 --file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/.env --project-name roottests3imdssessiontoken-gw3 --file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] [gw3] PASSED test_s3_imds/test_session_token.py::test_credentials_from_metadata Executing query drop workload X; on node Executing query drop workload X; on node Executing query select * from `postgres_database`.`postgresql_replica_1` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_1` order by key; on instance Executing query drop workload Y; on node Executing query drop workload Y; on node Executing query select * from `test_database`.`postgresql_replica_1` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_1` order by key; on instance Executing query drop workload Z; on node Executing query drop workload Z; on node Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_2` LIMIT 1 FORMAT Null on instance Executing query drop workload all; on node Executing query drop workload all; on node Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_2' on instance Command:[docker compose --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/.env --project-name roottestscheduler-gw1 --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node2/docker-compose.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/.env --project-name roottestscheduler-gw1 --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node2/docker-compose.yml stop --timeout 20] [gw1] PASSED test_scheduler/test.py::test_workload_hierarchy_changes Executing query select * from `postgres_database`.`postgresql_replica_2` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_2` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_2` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_2` order by key; on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_3` LIMIT 1 FORMAT Null on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_3' on instance Executing query select * from `postgres_database`.`postgresql_replica_3` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_3` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_3` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_3` order by key; on instance Connection dropped: socket connection error: No route to host Connection dropped: socket connection error: No route to host Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_4` LIMIT 1 FORMAT Null on instance Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Connecting to 172.16.2.4(172.16.2.4):2181, use_ssl: False Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_4' on instance Executing query select * from `postgres_database`.`postgresql_replica_4` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_4` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_4` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_4` order by key; on instance Executing query SELECT key, value1, value3 FROM test_database.postgresql_replica_3 ORDER BY key on instance Executing query SELECT key, value1, value3 FROM test_database.postgresql_replica_3 ORDER BY key on instance Executing query SELECT count() FROM test_database.postgresql_replica_1 on instance Executing query SELECT count() FROM test_database.postgresql_replica_1 on instance Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', 'timeout 30 tail -Fn100 "/var/log/clickhouse-server/clickhouse-server.log" | grep -Em 1 \'Table postgresql_replica_1 is skipped from replication stream\''] run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', 'timeout 30 tail -Fn100 "/var/log/clickhouse-server/clickhouse-server.log" | grep -Em 1 \'Table postgresql_replica_1 is skipped from replication stream\''] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c timeout 30 tail -Fn100 "/var/log/clickhouse-server/clickhouse-server.log" | grep -Em 1 'Table postgresql_replica_1 is skipped from replication stream'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c timeout 30 tail -Fn100 "/var/log/clickhouse-server/clickhouse-server.log" | grep -Em 1 'Table postgresql_replica_1 is skipped from replication stream'] Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node1-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node1-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node2-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node2-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node2-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node2-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node1-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node1-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo3-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo3-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo1-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo1-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/.env --project-name roottestreplicatedmergetreecompatibility-gw7 --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node2/docker-compose.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/.env --project-name roottestreplicatedmergetreecompatibility-gw7 --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_compatibility/_instances-0-gw7/node2/docker-compose.yml down --volumes] Connection dropped: socket connection error: No route to host Connection dropped: socket connection error: No route to host Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node1-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node1-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node2-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node2-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node1-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node1-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node1-1 Removing Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node1-1 Removing Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node2-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node2-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node2-1 Removing Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node2-1 Removing Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node2-1 Removed Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node2-1 Removed Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node1-1 Removed Stderr: Container roottestreplicatedmergetreecompatibility-gw7-node1-1 Removed Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo1-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo1-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo1-1 Removing Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo1-1 Removing Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo2-1 Removing Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo2-1 Removing Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo3-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo3-1 Stopped Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo3-1 Removing Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo3-1 Removing Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo1-1 Removed Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo1-1 Removed Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo3-1 Removed Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo3-1 Removed Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo2-1 Removed Stderr: Container roottestreplicatedmergetreecompatibility-gw7-zoo2-1 Removed Stderr: Network roottestreplicatedmergetreecompatibility-gw7_default Removing Stderr: Network roottestreplicatedmergetreecompatibility-gw7_default Removing Stderr: Network roottestreplicatedmergetreecompatibility-gw7_default Removed Stderr: Network roottestreplicatedmergetreecompatibility-gw7_default Removed Cleanup called Cleanup called Docker networks for project roottestreplicatedmergetreecompatibility-gw7 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedmergetreecompatibility-gw7 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicatedmergetreecompatibility-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedmergetreecompatibility-gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicatedmergetreecompatibility-gw7 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedmergetreecompatibility-gw7 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreplicatedmergetreecompatibility-gw7-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreplicatedmergetreecompatibility-gw7-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicatedmergetreecompatibility-gw7 No running containers for project: roottestreplicatedmergetreecompatibility-gw7 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:11 Stdout:11 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 11 Volumes pruned: 11 Stderr: Container roottests3storageclass-gw5-node-1 Stopping Stderr: Container roottests3storageclass-gw5-node-1 Stopping Stderr: Container roottests3storageclass-gw5-resolver-1 Stopping Stderr: Container roottests3storageclass-gw5-resolver-1 Stopping Stderr: Container roottests3storageclass-gw5-node-1 Stopped Stderr: Container roottests3storageclass-gw5-node-1 Stopped Stderr: Container roottests3storageclass-gw5-minio1-1 Stopping Stderr: Container roottests3storageclass-gw5-minio1-1 Stopping Stderr: Container roottests3storageclass-gw5-minio1-1 Stopped Stderr: Container roottests3storageclass-gw5-minio1-1 Stopped Stderr: Container roottests3storageclass-gw5-resolver-1 Stopped Stderr: Container roottests3storageclass-gw5-resolver-1 Stopped Stderr: Container roottests3storageclass-gw5-proxy1-1 Stopping Stderr: Container roottests3storageclass-gw5-proxy1-1 Stopping Stderr: Container roottests3storageclass-gw5-proxy2-1 Stopping Stderr: Container roottests3storageclass-gw5-proxy2-1 Stopping Stderr: Container roottests3storageclass-gw5-proxy1-1 Stopped Stderr: Container roottests3storageclass-gw5-proxy1-1 Stopped Stderr: Container roottests3storageclass-gw5-proxy2-1 Stopped Stderr: Container roottests3storageclass-gw5-proxy2-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/.env --project-name roottests3storageclass-gw5 --file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/.env --project-name roottests3storageclass-gw5 --file /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Stderr: Container roottests3storageclass-gw5-node-1 Stopping Stderr: Container roottests3storageclass-gw5-node-1 Stopping Stderr: Container roottests3storageclass-gw5-resolver-1 Stopping Stderr: Container roottests3storageclass-gw5-resolver-1 Stopping Stderr: Container roottests3storageclass-gw5-node-1 Stopped Stderr: Container roottests3storageclass-gw5-node-1 Stopped Stderr: Container roottests3storageclass-gw5-node-1 Removing Stderr: Container roottests3storageclass-gw5-node-1 Removing Stderr: Container roottests3storageclass-gw5-resolver-1 Stopped Stderr: Container roottests3storageclass-gw5-resolver-1 Stopped Stderr: Container roottests3storageclass-gw5-resolver-1 Removing Stderr: Container roottests3storageclass-gw5-resolver-1 Removing Stderr: Container roottests3storageclass-gw5-resolver-1 Removed Stderr: Container roottests3storageclass-gw5-resolver-1 Removed Stderr: Container roottests3storageclass-gw5-node-1 Removed Stderr: Container roottests3storageclass-gw5-node-1 Removed Stderr: Container roottests3storageclass-gw5-minio1-1 Stopping Stderr: Container roottests3storageclass-gw5-minio1-1 Stopping Stderr: Container roottests3storageclass-gw5-minio1-1 Stopped Stderr: Container roottests3storageclass-gw5-minio1-1 Stopped Stderr: Container roottests3storageclass-gw5-minio1-1 Removing Stderr: Container roottests3storageclass-gw5-minio1-1 Removing Stderr: Container roottests3storageclass-gw5-minio1-1 Removed Stderr: Container roottests3storageclass-gw5-minio1-1 Removed Stderr: Container roottests3storageclass-gw5-proxy1-1 Stopping Stderr: Container roottests3storageclass-gw5-proxy1-1 Stopping Stderr: Container roottests3storageclass-gw5-proxy2-1 Stopping Stderr: Container roottests3storageclass-gw5-proxy2-1 Stopping Stderr: Container roottests3storageclass-gw5-proxy1-1 Stopped Stderr: Container roottests3storageclass-gw5-proxy1-1 Stopped Stderr: Container roottests3storageclass-gw5-proxy1-1 Removing Stderr: Container roottests3storageclass-gw5-proxy1-1 Removing Stderr: Container roottests3storageclass-gw5-proxy2-1 Stopped Stderr: Container roottests3storageclass-gw5-proxy2-1 Stopped Stderr: Container roottests3storageclass-gw5-proxy2-1 Removing Stderr: Container roottests3storageclass-gw5-proxy2-1 Removing Stderr: Container roottests3storageclass-gw5-proxy1-1 Removed Stderr: Container roottests3storageclass-gw5-proxy1-1 Removed Stderr: Container roottests3storageclass-gw5-proxy2-1 Removed Stderr: Container roottests3storageclass-gw5-proxy2-1 Removed Stderr: Volume roottests3storageclass-gw5_data1-1 Removing Stderr: Volume roottests3storageclass-gw5_data1-1 Removing Stderr: Network roottests3storageclass-gw5_default Removing Stderr: Network roottests3storageclass-gw5_default Removing Stderr: Volume roottests3storageclass-gw5_data1-1 Removed Stderr: Volume roottests3storageclass-gw5_data1-1 Removed Stderr: Network roottests3storageclass-gw5_default Removed Stderr: Network roottests3storageclass-gw5_default Removed Cleanup called Cleanup called Docker networks for project roottests3storageclass-gw5 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3storageclass-gw5 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3storageclass-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3storageclass-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3storageclass-gw5 are DRIVER VOLUME NAME Docker volumes for project roottests3storageclass-gw5 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3storageclass-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3storageclass-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3storageclass-gw5 No running containers for project: roottests3storageclass-gw5 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:9 Stdout:9 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 9 Volumes pruned: 9 test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3] ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV HOSTNAME 3624a24af23d ENV HOSTNAME 3624a24af23d ENV SHLVL 0 ENV SHLVL 0 ENV HOME /root ENV HOME /root ENV OLDPWD / ENV OLDPWD / ENV DOCKER_HELPER_TAG 5dc43a6382f0 ENV DOCKER_HELPER_TAG 5dc43a6382f0 ENV PYTHONUNBUFFERED 1 ENV PYTHONUNBUFFERED 1 ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e ENV UBSAN_OPTIONS print_stacktrace=1 ENV UBSAN_OPTIONS print_stacktrace=1 ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots test_postgresql_replica_database_engine_1/test.py::test_virtual_columns test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_remote_prewhere/test.py::test_remote test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16]' 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12]' test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replicated_user_defined_functions/test.py::test_create_and_drop 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1]' 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0]' test_replicated_user_defined_functions/test.py::test_create_and_replace test_replicated_user_defined_functions/test.py::test_drop_if_exists test_replicated_user_defined_functions/test.py::test_reload_zookeeper test_replicated_user_defined_functions/test.py::test_replication test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation test_replicated_user_defined_functions/test.py::test_server_restart test_replicated_user_defined_functions/test.py::test_start_without_zookeeper test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_s3_imds/test_session_token.py::test_credentials_from_metadata test_s3_imds/test_simple.py::test_credentials_from_metadata test_s3_latency_log/test.py::test_latency_log test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver]' test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy test_scheduler/test.py::test_create_workload test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_resource_any_disk test_scheduler/test.py::test_resource_read_and_write test_scheduler/test.py::test_s3_disk test_scheduler/test.py::test_s3_resource_request_granularity test_scheduler/test.py::test_throw_on_unknown_workload test_scheduler/test.py::test_workload_entity_keeper_storage test_scheduler/test.py::test_workload_hierarchy_changes test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings -vvv -ss ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots test_postgresql_replica_database_engine_1/test.py::test_virtual_columns test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_remote_prewhere/test.py::test_remote test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16]' 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12]' test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replicated_user_defined_functions/test.py::test_create_and_drop 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1]' 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0]' test_replicated_user_defined_functions/test.py::test_create_and_replace test_replicated_user_defined_functions/test.py::test_drop_if_exists test_replicated_user_defined_functions/test.py::test_reload_zookeeper test_replicated_user_defined_functions/test.py::test_replication test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation test_replicated_user_defined_functions/test.py::test_server_restart test_replicated_user_defined_functions/test.py::test_start_without_zookeeper test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_s3_imds/test_session_token.py::test_credentials_from_metadata test_s3_imds/test_simple.py::test_credentials_from_metadata test_s3_latency_log/test.py::test_latency_log test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver]' test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy test_scheduler/test.py::test_create_workload test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_resource_any_disk test_scheduler/test.py::test_resource_read_and_write test_scheduler/test.py::test_s3_disk test_scheduler/test.py::test_s3_resource_request_granularity test_scheduler/test.py::test_throw_on_unknown_workload test_scheduler/test.py::test_workload_entity_keeper_storage test_scheduler/test.py::test_workload_hierarchy_changes test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings -vvv -ss ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge ENV COMPOSE_HTTP_TIMEOUT 600 ENV COMPOSE_HTTP_TIMEOUT 600 ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_CHANNEL stable ENV DOCKER_CHANNEL stable ENV DOCKER_CLIENT_TIMEOUT 300 ENV DOCKER_CLIENT_TIMEOUT 300 ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV PWD /ClickHouse/tests/integration ENV PWD /ClickHouse/tests/integration ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV TZ Etc/UTC ENV TZ Etc/UTC ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV DOCKER_BASE_TAG 8b2301119731 ENV DOCKER_BASE_TAG 8b2301119731 ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV LC_CTYPE C.UTF-8 ENV LC_CTYPE C.UTF-8 ENV INTEGRATION_TESTS_RUN_ID 0 ENV INTEGRATION_TESTS_RUN_ID 0 ENV WORKER_FREE_PORTS 30250 30251 30252 30253 30254 30255 30256 30257 30258 30259 30260 30261 30262 30263 30264 30265 30266 30267 30268 30269 30270 30271 30272 30273 30274 30275 30276 30277 30278 30279 30280 30281 30282 30283 30284 30285 30286 30287 30288 30289 30290 30291 30292 30293 30294 30295 30296 30297 30298 30299 ENV WORKER_FREE_PORTS 30250 30251 30252 30253 30254 30255 30256 30257 30258 30259 30260 30261 30262 30263 30264 30265 30266 30267 30268 30269 30270 30271 30272 30273 30274 30275 30276 30277 30278 30279 30280 30281 30282 30283 30284 30285 30286 30287 30288 30289 30290 30291 30292 30293 30294 30295 30296 30297 30298 30299 ENV PYTEST_XDIST_TESTRUNUID c5ba503209524253afe87e95762d6d1b ENV PYTEST_XDIST_TESTRUNUID c5ba503209524253afe87e95762d6d1b ENV PYTEST_XDIST_WORKER gw5 ENV PYTEST_XDIST_WORKER gw5 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV SSL_CERT_FILE /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/minio/certs/public.crt ENV SSL_CERT_FILE /ClickHouse/tests/integration/test_s3_storage_class/_instances-0-gw5/minio/certs/public.crt ENV PYTEST_CURRENT_TEST test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3] (setup) ENV PYTEST_CURRENT_TEST test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3] (setup) CLUSTER INIT base_config_dir:/clickhouse-config CLUSTER INIT base_config_dir:/clickhouse-config clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Cluster name: project_name:roottests3storageconfnewproxy-gw5. Added instance name:node tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/.env', '--project-name', 'roottests3storageconfnewproxy-gw5', '--file', '/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottests3storageconfnewproxy-gw5. Added instance name:node tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/.env', '--project-name', 'roottests3storageconfnewproxy-gw5', '--file', '/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Starting cluster... Starting cluster... Running tests in /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/test.py Running tests in /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottests3storageconfnewproxy-gw5 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3storageconfnewproxy-gw5 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3storageconfnewproxy-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3storageconfnewproxy-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3storageconfnewproxy-gw5 are DRIVER VOLUME NAME Docker volumes for project roottests3storageconfnewproxy-gw5 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottests3storageconfnewproxy-gw5 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3storageconfnewproxy-gw5 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3storageconfnewproxy-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3storageconfnewproxy-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3storageconfnewproxy-gw5 are DRIVER VOLUME NAME Docker volumes for project roottests3storageconfnewproxy-gw5 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3storageconfnewproxy-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3storageconfnewproxy-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3storageconfnewproxy-gw5 No running containers for project: roottests3storageconfnewproxy-gw5 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:9 Stdout:9 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 9 Volumes pruned: 9 Setup directory for instance: node Setup directory for instance: node Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/configs/config.d/storage_conf.xml', '/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/configs/config.d/proxy_list.xml'] to /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/node/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/configs/config.d/storage_conf.xml', '/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/configs/config.d/proxy_list.xml'] to /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/node/configs/config.d Setup database dir /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/node/database Setup database dir /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/node/database Setup logs dir /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/node/logs Setup logs dir /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/node/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/.env --project-name roottests3storageconfnewproxy-gw5 --file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/.env --project-name roottests3storageconfnewproxy-gw5 --file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Stdout:2025.04.02 02:56:53.118424 [ 918 ] {} PostgreSQLReplicaConsumer(postgres_database): Table postgresql_replica_1 is skipped from replication stream because its structure has changes. Please detach this table and reattach to resume the replication (relation id: 16757) Stdout:2025.04.02 02:56:53.118424 [ 918 ] {} PostgreSQLReplicaConsumer(postgres_database): Table postgresql_replica_1 is skipped from replication stream because its structure has changes. Please detach this table and reattach to resume the replication (relation id: 16757) 1 log line(s) matching "Table postgresql_replica_1 is skipped from replication stream" appeared in a 6.222 seconds 1 log line(s) matching "Table postgresql_replica_1 is skipped from replication stream" appeared in a 6.222 seconds Executing query SELECT count() FROM test_database.postgresql_replica_1 on instance Executing query SELECT count() FROM test_database.postgresql_replica_1 on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance [gw0] PASSED test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots Executing query INSERT INTO `postgres_database`.`test_table` SELECT number, number from numbers(50) on instance Executing query INSERT INTO `postgres_database`.`test_table` SELECT number, number from numbers(50) on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') SETTINGS materialized_postgresql_replication_slot = 'user_slot', materialized_postgresql_snapshot = '000000D5-0000000E-1' on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') SETTINGS materialized_postgresql_replication_slot = 'user_slot', materialized_postgresql_snapshot = '000000D5-0000000E-1' on instance Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance Executing query SELECT * FROM `test_database`.`test_table` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`test_table` LIMIT 1 FORMAT Null on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_table' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_table' on instance Executing query select * from `postgres_database`.`test_table` order by key; on instance Executing query select * from `postgres_database`.`test_table` order by key; on instance Executing query select * from `test_database`.`test_table` order by key; on instance Executing query select * from `test_database`.`test_table` order by key; on instance Executing query INSERT INTO postgres_database.test_table SELECT number, number from numbers(10000, 10000) on instance Executing query INSERT INTO postgres_database.test_table SELECT number, number from numbers(10000, 10000) on instance Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --project-name roottestreloadclientcertificate-gw9 --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node2/docker-compose.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --project-name roottestreloadclientcertificate-gw9 --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node2/docker-compose.yml stop --timeout 20] [gw9] PASSED test_reload_client_certificate/test.py::test_wrong_cn_cert Executing query SELECT * FROM `test_database`.`test_table` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`test_table` LIMIT 1 FORMAT Null on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_table' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_table' on instance Executing query select * from `postgres_database`.`test_table` order by key; on instance Executing query select * from `postgres_database`.`test_table` order by key; on instance Executing query select * from `test_database`.`test_table` order by key; on instance Executing query select * from `test_database`.`test_table` order by key; on instance run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps -C clickhouse] Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 775 ? 00:00:26 clickhouse Stdout: 775 ? 00:00:26 clickhouse run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c pkill clickhouse] run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:775 Stdout:775 Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:775 Stdout:775 Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:775 Stdout:775 Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: minio1 Pulling Stderr: minio1 Pulling Stderr: resolver Pulling Stderr: resolver Pulling Stderr: node Pulling Stderr: node Pulling Stderr: proxy1 Pulling Stderr: proxy1 Pulling Stderr: resolver Pulled Stderr: resolver Pulled Stderr: node Pulled Stderr: node Pulled Stderr: minio1 Pulled Stderr: minio1 Pulled Stderr: proxy1 Pulled Stderr: proxy1 Pulled Trying to create Minio instance by command docker compose --project-name roottests3storageconfnewproxy-gw5 --env-file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Trying to create Minio instance by command docker compose --project-name roottests3storageconfnewproxy-gw5 --env-file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Command:[docker compose --project-name roottests3storageconfnewproxy-gw5 --env-file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Command:[docker compose --project-name roottests3storageconfnewproxy-gw5 --env-file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:775 Stdout:775 Stderr:time="2025-04-02T02:57:01Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:57:01Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottests3storageconfnewproxy-gw5_default Creating Stderr: Network roottests3storageconfnewproxy-gw5_default Creating Stderr: Network roottests3storageconfnewproxy-gw5_default Created Stderr: Network roottests3storageconfnewproxy-gw5_default Created Stderr: Volume "roottests3storageconfnewproxy-gw5_data1-1" Creating Stderr: Volume "roottests3storageconfnewproxy-gw5_data1-1" Creating Stderr: Volume "roottests3storageconfnewproxy-gw5_data1-1" Created Stderr: Volume "roottests3storageconfnewproxy-gw5_data1-1" Created Stderr: Container roottests3storageconfnewproxy-gw5-proxy2-1 Creating Stderr: Container roottests3storageconfnewproxy-gw5-proxy2-1 Creating Stderr: Container roottests3storageconfnewproxy-gw5-proxy1-1 Creating Stderr: Container roottests3storageconfnewproxy-gw5-proxy1-1 Creating Stderr: Container roottests3storageconfnewproxy-gw5-proxy2-1 Created Stderr: Container roottests3storageconfnewproxy-gw5-proxy2-1 Created Stderr: Container roottests3storageconfnewproxy-gw5-proxy1-1 Created Stderr: Container roottests3storageconfnewproxy-gw5-proxy1-1 Created Stderr: Container roottests3storageconfnewproxy-gw5-minio1-1 Creating Stderr: Container roottests3storageconfnewproxy-gw5-minio1-1 Creating Stderr: Container roottests3storageconfnewproxy-gw5-resolver-1 Creating Stderr: Container roottests3storageconfnewproxy-gw5-resolver-1 Creating Stderr: Container roottests3storageconfnewproxy-gw5-resolver-1 Created Stderr: Container roottests3storageconfnewproxy-gw5-resolver-1 Created Stderr: Container roottests3storageconfnewproxy-gw5-minio1-1 Created Stderr: Container roottests3storageconfnewproxy-gw5-minio1-1 Created Stderr: Container roottests3storageconfnewproxy-gw5-proxy2-1 Starting Stderr: Container roottests3storageconfnewproxy-gw5-proxy2-1 Starting Stderr: Container roottests3storageconfnewproxy-gw5-proxy1-1 Starting Stderr: Container roottests3storageconfnewproxy-gw5-proxy1-1 Starting Stderr: Container roottests3storageconfnewproxy-gw5-proxy2-1 Started Stderr: Container roottests3storageconfnewproxy-gw5-proxy2-1 Started Stderr: Container roottests3storageconfnewproxy-gw5-proxy1-1 Started Stderr: Container roottests3storageconfnewproxy-gw5-proxy1-1 Started Stderr: Container roottests3storageconfnewproxy-gw5-minio1-1 Starting Stderr: Container roottests3storageconfnewproxy-gw5-minio1-1 Starting Stderr: Container roottests3storageconfnewproxy-gw5-resolver-1 Starting Stderr: Container roottests3storageconfnewproxy-gw5-resolver-1 Starting Stderr: Container roottests3storageconfnewproxy-gw5-resolver-1 Started Stderr: Container roottests3storageconfnewproxy-gw5-resolver-1 Started Stderr: Container roottests3storageconfnewproxy-gw5-minio1-1 Started Stderr: Container roottests3storageconfnewproxy-gw5-minio1-1 Started Stderr:time="2025-04-02T02:57:02Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:57:02Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:57:02Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:57:02Z" level=debug msg="otel error" error="" Trying to connect to Minio... Trying to connect to Minio... get_instance_ip instance_name=minio1 get_instance_ip instance_name=minio1 http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-minio1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-minio1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy1 get_instance_ip instance_name=proxy1 http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None Starting new HTTP connection (1): 172.16.2.4:9001 Starting new HTTP connection (1): 172.16.2.4:9001 Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (2): 172.16.2.4:9001 Starting new HTTP connection (2): 172.16.2.4:9001 Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (3): 172.16.2.4:9001 Starting new HTTP connection (3): 172.16.2.4:9001 Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (4): 172.16.2.4:9001 Starting new HTTP connection (4): 172.16.2.4:9001 Can't connect to Minio: HTTPConnectionPool(host='172.16.2.4', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Can't connect to Minio: HTTPConnectionPool(host='172.16.2.4', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestpostgresqlreplicadatabaseengine1-gw0-instance-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestpostgresqlreplicadatabaseengine1-gw0-instance-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/2264ff9afc2d00190dce1bec4dc12895aa2a278c5aa69578be9b447f85ab917a/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/2264ff9afc2d00190dce1bec4dc12895aa2a278c5aa69578be9b447f85ab917a/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/2264ff9afc2d00190dce1bec4dc12895aa2a278c5aa69578be9b447f85ab917a/json HTTP/1.1" 200 586 http://localhost:None "GET /v1.46/exec/2264ff9afc2d00190dce1bec4dc12895aa2a278c5aa69578be9b447f85ab917a/json HTTP/1.1" 200 586 Stderr: Container roottests3imdssessiontoken-gw3-node-1 Stopping Stderr: Container roottests3imdssessiontoken-gw3-node-1 Stopping Stderr: Container roottests3imdssessiontoken-gw3-resolver-1 Stopping Stderr: Container roottests3imdssessiontoken-gw3-resolver-1 Stopping Stderr: Container roottests3imdssessiontoken-gw3-node-1 Stopped Stderr: Container roottests3imdssessiontoken-gw3-node-1 Stopped Stderr: Container roottests3imdssessiontoken-gw3-minio1-1 Stopping Stderr: Container roottests3imdssessiontoken-gw3-minio1-1 Stopping Stderr: Container roottests3imdssessiontoken-gw3-minio1-1 Stopped Stderr: Container roottests3imdssessiontoken-gw3-minio1-1 Stopped Stderr: Container roottests3imdssessiontoken-gw3-resolver-1 Stopped Stderr: Container roottests3imdssessiontoken-gw3-resolver-1 Stopped Stderr: Container roottests3imdssessiontoken-gw3-proxy2-1 Stopping Stderr: Container roottests3imdssessiontoken-gw3-proxy2-1 Stopping Stderr: Container roottests3imdssessiontoken-gw3-proxy1-1 Stopping Stderr: Container roottests3imdssessiontoken-gw3-proxy1-1 Stopping Stderr: Container roottests3imdssessiontoken-gw3-proxy2-1 Stopped Stderr: Container roottests3imdssessiontoken-gw3-proxy2-1 Stopped Stderr: Container roottests3imdssessiontoken-gw3-proxy1-1 Stopped Stderr: Container roottests3imdssessiontoken-gw3-proxy1-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/.env --project-name roottests3imdssessiontoken-gw3 --file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/.env --project-name roottests3imdssessiontoken-gw3 --file /ClickHouse/tests/integration/test_s3_imds/_instances-session_token-0-gw3/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Starting new HTTP connection (5): 172.16.2.4:9001 Starting new HTTP connection (5): 172.16.2.4:9001 http://172.16.2.4:9001 "GET / HTTP/1.1" 200 0 http://172.16.2.4:9001 "GET / HTTP/1.1" 200 0 Connected to Minio. Connected to Minio. http://172.16.2.4:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.2.4:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.2.4:9001 "PUT /root HTTP/1.1" 200 0 http://172.16.2.4:9001 "PUT /root HTTP/1.1" 200 0 S3 bucket 'root' created S3 bucket 'root' created http://172.16.2.4:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.2.4:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.2.4:9001 "PUT /root2 HTTP/1.1" 200 0 http://172.16.2.4:9001 "PUT /root2 HTTP/1.1" 200 0 S3 bucket 'root2' created S3 bucket 'root2' created ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/.env --project-name roottests3storageconfnewproxy-gw5 --file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/.env --project-name roottests3storageconfnewproxy-gw5 --file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/.env --project-name roottests3storageconfnewproxy-gw5 --file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/.env --project-name roottests3storageconfnewproxy-gw5 --file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Stderr: Container roottests3imdssessiontoken-gw3-node-1 Stopping Stderr: Container roottests3imdssessiontoken-gw3-node-1 Stopping Stderr: Container roottests3imdssessiontoken-gw3-resolver-1 Stopping Stderr: Container roottests3imdssessiontoken-gw3-resolver-1 Stopping Stderr: Container roottests3imdssessiontoken-gw3-node-1 Stopped Stderr: Container roottests3imdssessiontoken-gw3-node-1 Stopped Stderr: Container roottests3imdssessiontoken-gw3-node-1 Removing Stderr: Container roottests3imdssessiontoken-gw3-node-1 Removing Stderr: Container roottests3imdssessiontoken-gw3-resolver-1 Stopped Stderr: Container roottests3imdssessiontoken-gw3-resolver-1 Stopped Stderr: Container roottests3imdssessiontoken-gw3-resolver-1 Removing Stderr: Container roottests3imdssessiontoken-gw3-resolver-1 Removing Stderr: Container roottests3imdssessiontoken-gw3-node-1 Removed Stderr: Container roottests3imdssessiontoken-gw3-node-1 Removed Stderr: Container roottests3imdssessiontoken-gw3-minio1-1 Stopping Stderr: Container roottests3imdssessiontoken-gw3-minio1-1 Stopping Stderr: Container roottests3imdssessiontoken-gw3-minio1-1 Stopped Stderr: Container roottests3imdssessiontoken-gw3-minio1-1 Stopped Stderr: Container roottests3imdssessiontoken-gw3-minio1-1 Removing Stderr: Container roottests3imdssessiontoken-gw3-minio1-1 Removing Stderr: Container roottests3imdssessiontoken-gw3-resolver-1 Removed Stderr: Container roottests3imdssessiontoken-gw3-resolver-1 Removed Stderr: Container roottests3imdssessiontoken-gw3-minio1-1 Removed Stderr: Container roottests3imdssessiontoken-gw3-minio1-1 Removed Stderr: Container roottests3imdssessiontoken-gw3-proxy2-1 Stopping Stderr: Container roottests3imdssessiontoken-gw3-proxy2-1 Stopping Stderr: Container roottests3imdssessiontoken-gw3-proxy1-1 Stopping Stderr: Container roottests3imdssessiontoken-gw3-proxy1-1 Stopping Stderr: Container roottests3imdssessiontoken-gw3-proxy2-1 Stopped Stderr: Container roottests3imdssessiontoken-gw3-proxy2-1 Stopped Stderr: Container roottests3imdssessiontoken-gw3-proxy2-1 Removing Stderr: Container roottests3imdssessiontoken-gw3-proxy2-1 Removing Stderr: Container roottests3imdssessiontoken-gw3-proxy1-1 Stopped Stderr: Container roottests3imdssessiontoken-gw3-proxy1-1 Stopped Stderr: Container roottests3imdssessiontoken-gw3-proxy1-1 Removing Stderr: Container roottests3imdssessiontoken-gw3-proxy1-1 Removing Stderr: Container roottests3imdssessiontoken-gw3-proxy2-1 Removed Stderr: Container roottests3imdssessiontoken-gw3-proxy2-1 Removed Stderr: Container roottests3imdssessiontoken-gw3-proxy1-1 Removed Stderr: Container roottests3imdssessiontoken-gw3-proxy1-1 Removed Stderr: Volume roottests3imdssessiontoken-gw3_data1-1 Removing Stderr: Volume roottests3imdssessiontoken-gw3_data1-1 Removing Stderr: Network roottests3imdssessiontoken-gw3_default Removing Stderr: Network roottests3imdssessiontoken-gw3_default Removing Stderr: Volume roottests3imdssessiontoken-gw3_data1-1 Removed Stderr: Volume roottests3imdssessiontoken-gw3_data1-1 Removed Stderr: Network roottests3imdssessiontoken-gw3_default Removed Stderr: Network roottests3imdssessiontoken-gw3_default Removed Cleanup called Cleanup called Docker networks for project roottests3imdssessiontoken-gw3 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3imdssessiontoken-gw3 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3imdssessiontoken-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3imdssessiontoken-gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3imdssessiontoken-gw3 are DRIVER VOLUME NAME Docker volumes for project roottests3imdssessiontoken-gw3 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3imdssessiontoken-gw3-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3imdssessiontoken-gw3-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3imdssessiontoken-gw3 No running containers for project: roottests3imdssessiontoken-gw3 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:9 Stdout:9 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 9 Volumes pruned: 9 run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stderr: Container roottests3storageconfnewproxy-gw5-proxy2-1 Running Stderr: Container roottests3storageconfnewproxy-gw5-proxy2-1 Running Stderr: Container roottests3storageconfnewproxy-gw5-proxy1-1 Running Stderr: Container roottests3storageconfnewproxy-gw5-proxy1-1 Running Stderr: Container roottests3storageconfnewproxy-gw5-minio1-1 Running Stderr: Container roottests3storageconfnewproxy-gw5-minio1-1 Running Stderr: Container roottests3storageconfnewproxy-gw5-resolver-1 Running Stderr: Container roottests3storageconfnewproxy-gw5-resolver-1 Running Stderr: Container roottests3storageconfnewproxy-gw5-node-1 Creating Stderr: Container roottests3storageconfnewproxy-gw5-node-1 Creating Stderr: Container roottests3storageconfnewproxy-gw5-node-1 Created Stderr: Container roottests3storageconfnewproxy-gw5-node-1 Created Stderr: Container roottests3storageconfnewproxy-gw5-node-1 Starting Stderr: Container roottests3storageconfnewproxy-gw5-node-1 Starting Stderr: Container roottests3storageconfnewproxy-gw5-node-1 Started Stderr: Container roottests3storageconfnewproxy-gw5-node-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-node-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-node-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node, ip: 172.16.2.6... Waiting for ClickHouse start in node, ip: 172.16.2.6... http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None Stdout:1586 Stdout:1586 Clickhouse process running. Clickhouse process running. run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:1586 Stdout:1586 Executing query select 20 on instance Executing query select 20 on instance http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None Stderr: Container roottestscheduler-gw1-node-1 Stopping Stderr: Container roottestscheduler-gw1-node-1 Stopping Stderr: Container roottestscheduler-gw1-node2-1 Stopping Stderr: Container roottestscheduler-gw1-node2-1 Stopping Stderr: Container roottestscheduler-gw1-resolver-1 Stopping Stderr: Container roottestscheduler-gw1-resolver-1 Stopping Stderr: Container roottestscheduler-gw1-node2-1 Stopped Stderr: Container roottestscheduler-gw1-node2-1 Stopped Stderr: Container roottestscheduler-gw1-node-1 Stopped Stderr: Container roottestscheduler-gw1-node-1 Stopped Stderr: Container roottestscheduler-gw1-zoo2-1 Stopping Stderr: Container roottestscheduler-gw1-zoo2-1 Stopping Stderr: Container roottestscheduler-gw1-zoo3-1 Stopping Stderr: Container roottestscheduler-gw1-zoo3-1 Stopping Stderr: Container roottestscheduler-gw1-minio1-1 Stopping Stderr: Container roottestscheduler-gw1-minio1-1 Stopping Stderr: Container roottestscheduler-gw1-zoo1-1 Stopping Stderr: Container roottestscheduler-gw1-zoo1-1 Stopping Stderr: Container roottestscheduler-gw1-minio1-1 Stopped Stderr: Container roottestscheduler-gw1-minio1-1 Stopped Stderr: Container roottestscheduler-gw1-zoo3-1 Stopped Stderr: Container roottestscheduler-gw1-zoo3-1 Stopped Stderr: Container roottestscheduler-gw1-zoo1-1 Stopped Stderr: Container roottestscheduler-gw1-zoo1-1 Stopped Stderr: Container roottestscheduler-gw1-zoo2-1 Stopped Stderr: Container roottestscheduler-gw1-zoo2-1 Stopped Stderr: Container roottestscheduler-gw1-resolver-1 Stopped Stderr: Container roottestscheduler-gw1-resolver-1 Stopped Stderr: Container roottestscheduler-gw1-proxy2-1 Stopping Stderr: Container roottestscheduler-gw1-proxy2-1 Stopping Stderr: Container roottestscheduler-gw1-proxy1-1 Stopping Stderr: Container roottestscheduler-gw1-proxy1-1 Stopping Stderr: Container roottestscheduler-gw1-proxy1-1 Stopped Stderr: Container roottestscheduler-gw1-proxy1-1 Stopped Stderr: Container roottestscheduler-gw1-proxy2-1 Stopped Stderr: Container roottestscheduler-gw1-proxy2-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/.env --project-name roottestscheduler-gw1 --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node2/docker-compose.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/.env --project-name roottestscheduler-gw1 --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_scheduler/_instances-0-gw1/node2/docker-compose.yml down --volumes] http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None Executing query select 20 on instance Executing query select 20 on instance http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None Stderr: Container roottestscheduler-gw1-node2-1 Stopping Stderr: Container roottestscheduler-gw1-node2-1 Stopping Stderr: Container roottestscheduler-gw1-node-1 Stopping Stderr: Container roottestscheduler-gw1-node-1 Stopping Stderr: Container roottestscheduler-gw1-resolver-1 Stopping Stderr: Container roottestscheduler-gw1-resolver-1 Stopping Stderr: Container roottestscheduler-gw1-node2-1 Stopped Stderr: Container roottestscheduler-gw1-node2-1 Stopped Stderr: Container roottestscheduler-gw1-node2-1 Removing Stderr: Container roottestscheduler-gw1-node2-1 Removing Stderr: Container roottestscheduler-gw1-resolver-1 Stopped Stderr: Container roottestscheduler-gw1-resolver-1 Stopped Stderr: Container roottestscheduler-gw1-resolver-1 Removing Stderr: Container roottestscheduler-gw1-resolver-1 Removing Stderr: Container roottestscheduler-gw1-node-1 Stopped Stderr: Container roottestscheduler-gw1-node-1 Stopped Stderr: Container roottestscheduler-gw1-node-1 Removing Stderr: Container roottestscheduler-gw1-node-1 Removing Stderr: Container roottestscheduler-gw1-node2-1 Removed Stderr: Container roottestscheduler-gw1-node2-1 Removed Stderr: Container roottestscheduler-gw1-node-1 Removed Stderr: Container roottestscheduler-gw1-node-1 Removed Stderr: Container roottestscheduler-gw1-minio1-1 Stopping Stderr: Container roottestscheduler-gw1-minio1-1 Stopping Stderr: Container roottestscheduler-gw1-zoo1-1 Stopping Stderr: Container roottestscheduler-gw1-zoo1-1 Stopping Stderr: Container roottestscheduler-gw1-zoo2-1 Stopping Stderr: Container roottestscheduler-gw1-zoo2-1 Stopping Stderr: Container roottestscheduler-gw1-zoo3-1 Stopping Stderr: Container roottestscheduler-gw1-zoo3-1 Stopping Stderr: Container roottestscheduler-gw1-minio1-1 Stopped Stderr: Container roottestscheduler-gw1-minio1-1 Stopped Stderr: Container roottestscheduler-gw1-minio1-1 Removing Stderr: Container roottestscheduler-gw1-minio1-1 Removing Stderr: Container roottestscheduler-gw1-zoo1-1 Stopped Stderr: Container roottestscheduler-gw1-zoo1-1 Stopped Stderr: Container roottestscheduler-gw1-zoo1-1 Removing Stderr: Container roottestscheduler-gw1-zoo1-1 Removing Stderr: Container roottestscheduler-gw1-zoo2-1 Stopped Stderr: Container roottestscheduler-gw1-zoo2-1 Stopped Stderr: Container roottestscheduler-gw1-zoo2-1 Removing Stderr: Container roottestscheduler-gw1-zoo2-1 Removing Stderr: Container roottestscheduler-gw1-zoo3-1 Stopped Stderr: Container roottestscheduler-gw1-zoo3-1 Stopped Stderr: Container roottestscheduler-gw1-zoo3-1 Removing Stderr: Container roottestscheduler-gw1-zoo3-1 Removing Stderr: Container roottestscheduler-gw1-resolver-1 Removed Stderr: Container roottestscheduler-gw1-resolver-1 Removed Stderr: Container roottestscheduler-gw1-zoo1-1 Removed Stderr: Container roottestscheduler-gw1-zoo1-1 Removed Stderr: Container roottestscheduler-gw1-zoo2-1 Removed Stderr: Container roottestscheduler-gw1-zoo2-1 Removed Stderr: Container roottestscheduler-gw1-zoo3-1 Removed Stderr: Container roottestscheduler-gw1-zoo3-1 Removed Stderr: Container roottestscheduler-gw1-minio1-1 Removed Stderr: Container roottestscheduler-gw1-minio1-1 Removed Stderr: Container roottestscheduler-gw1-proxy2-1 Stopping Stderr: Container roottestscheduler-gw1-proxy2-1 Stopping Stderr: Container roottestscheduler-gw1-proxy1-1 Stopping Stderr: Container roottestscheduler-gw1-proxy1-1 Stopping Stderr: Container roottestscheduler-gw1-proxy2-1 Stopped Stderr: Container roottestscheduler-gw1-proxy2-1 Stopped Stderr: Container roottestscheduler-gw1-proxy2-1 Removing Stderr: Container roottestscheduler-gw1-proxy2-1 Removing Stderr: Container roottestscheduler-gw1-proxy1-1 Stopped Stderr: Container roottestscheduler-gw1-proxy1-1 Stopped Stderr: Container roottestscheduler-gw1-proxy1-1 Removing Stderr: Container roottestscheduler-gw1-proxy1-1 Removing Stderr: Container roottestscheduler-gw1-proxy2-1 Removed Stderr: Container roottestscheduler-gw1-proxy2-1 Removed Stderr: Container roottestscheduler-gw1-proxy1-1 Removed Stderr: Container roottestscheduler-gw1-proxy1-1 Removed Stderr: Volume roottestscheduler-gw1_data1-1 Removing Stderr: Volume roottestscheduler-gw1_data1-1 Removing Stderr: Network roottestscheduler-gw1_default Removing Stderr: Network roottestscheduler-gw1_default Removing Stderr: Volume roottestscheduler-gw1_data1-1 Removed Stderr: Volume roottestscheduler-gw1_data1-1 Removed Stderr: Network roottestscheduler-gw1_default Removed Stderr: Network roottestscheduler-gw1_default Removed Cleanup called Cleanup called Docker networks for project roottestscheduler-gw1 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestscheduler-gw1 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestscheduler-gw1 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestscheduler-gw1 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestscheduler-gw1 are DRIVER VOLUME NAME Docker volumes for project roottestscheduler-gw1 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestscheduler-gw1-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestscheduler-gw1-.*-1$' --format '{{.ID}}:{{.Names}}'] http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestscheduler-gw1 No running containers for project: roottestscheduler-gw1 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:7 Stdout:7 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 7 Volumes pruned: 7 test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper Running tests in /ClickHouse/tests/integration/test_remove_stale_moving_parts/test.py Running tests in /ClickHouse/tests/integration/test_remove_stale_moving_parts/test.py Cluster start called. is_up=False Cluster start called. is_up=False http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None Docker networks for project roottestremovestalemovingparts-gw1 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestremovestalemovingparts-gw1 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestremovestalemovingparts-gw1 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestremovestalemovingparts-gw1 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestremovestalemovingparts-gw1 are DRIVER VOLUME NAME Docker volumes for project roottestremovestalemovingparts-gw1 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottestremovestalemovingparts-gw1 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestremovestalemovingparts-gw1 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestremovestalemovingparts-gw1 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestremovestalemovingparts-gw1 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestremovestalemovingparts-gw1 are DRIVER VOLUME NAME Docker volumes for project roottestremovestalemovingparts-gw1 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestremovestalemovingparts-gw1-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestremovestalemovingparts-gw1-.*-1$' --format '{{.ID}}:{{.Names}}'] http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestremovestalemovingparts-gw1 No running containers for project: roottestremovestalemovingparts-gw1 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:7 Stdout:7 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 7 Volumes pruned: 7 Setup directory for instance: ch1 Setup directory for instance: ch1 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_remove_stale_moving_parts/config.xml'] to /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/ch1/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_remove_stale_moving_parts/config.xml'] to /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/ch1/configs/config.d Setup database dir /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/ch1/database Setup database dir /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/ch1/database Setup logs dir /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/ch1/logs Setup logs dir /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/ch1/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/.env --project-name roottestremovestalemovingparts-gw1 --file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/ch1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/.env --project-name roottestremovestalemovingparts-gw1 --file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/ch1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None Executing query select 20 on instance Executing query select 20 on instance http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None Executing query select 20 on instance Executing query select 20 on instance http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/daf96b85ebbb618935793c6ac6294300cebf5fedad6c29ba444d1199a3cab556/json HTTP/1.1" 200 None ClickHouse node started ClickHouse node started Cluster started Cluster started Executing query CREATE TABLE s3_test ( id Int64, data String ) ENGINE=MergeTree() ORDER BY id SETTINGS storage_policy='s3' on node Executing query CREATE TABLE s3_test ( id Int64, data String ) ENGINE=MergeTree() ORDER BY id SETTINGS storage_policy='s3' on node Executing query INSERT INTO s3_test VALUES (0,'data'),(1,'data') on node Executing query INSERT INTO s3_test VALUES (0,'data'),(1,'data') on node Executing query select 20 on instance Executing query select 20 on instance Executing query SELECT * FROM s3_test order by id FORMAT Values on node Executing query SELECT * FROM s3_test order by id FORMAT Values on node Executing query INSERT INTO postgres_database.test_table SELECT number, number from numbers(20000, 10000) on instance Executing query INSERT INTO postgres_database.test_table SELECT number, number from numbers(20000, 10000) on instance Executing query DROP TABLE IF EXISTS s3_test SYNC on node Executing query DROP TABLE IF EXISTS s3_test SYNC on node http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None Executing query SELECT * FROM `test_database`.`test_table` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`test_table` LIMIT 1 FORMAT Null on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_table' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'test_table' on instance Executing query select * from `postgres_database`.`test_table` order by key; on instance Executing query select * from `postgres_database`.`test_table` order by key; on instance Executing query select * from `test_database`.`test_table` order by key; on instance Executing query select * from `test_database`.`test_table` order by key; on instance http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance [gw0] PASSED test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None test_postgresql_replica_database_engine_1/test.py::test_virtual_columns Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query DROP DATABASE IF EXISTS `test_database` on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE `test_database` ENGINE = MaterializedPostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Executing query SHOW DATABASES on instance Executing query SHOW DATABASES on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query INSERT INTO postgres_database.postgresql_replica_0 SELECT number, number from numbers(10) on instance Executing query INSERT INTO postgres_database.postgresql_replica_0 SELECT number, number from numbers(10) on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SELECT * FROM `test_database`.`postgresql_replica_0` LIMIT 1 FORMAT Null on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance Executing query SHOW TABLES FROM `test_database` WHERE name = 'postgresql_replica_0' on instance http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `postgres_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query select * from `test_database`.`postgresql_replica_0` order by key; on instance Executing query SELECT key, value, _sign, _version FROM test_database.postgresql_replica_0; on instance Executing query SELECT key, value, _sign, _version FROM test_database.postgresql_replica_0; on instance Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance Executing query DROP DATABASE IF EXISTS `test_database` SYNC on instance [gw0] PASSED test_postgresql_replica_database_engine_1/test.py::test_virtual_columns Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-node1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-node1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-node2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-node2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-node2-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-node2-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-node1-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-node1-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --project-name roottestreloadclientcertificate-gw9 --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node2/docker-compose.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/.env --project-name roottestreloadclientcertificate-gw9 --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_zookeeper_secure.yml --file /ClickHouse/tests/integration/test_reload_client_certificate/_instances-0-gw9/node2/docker-compose.yml down --volumes] Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query DROP DATABASE IF EXISTS "postgres_database" on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Executing query CREATE DATABASE "postgres_database" ENGINE = PostgreSQL('172.16.10.2:5432', 'postgres_database', 'postgres', 'mysecretpassword') on instance Command:[docker compose --env-file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/.env --project-name roottestpostgresqlreplicadatabaseengine1-gw0 --file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/instance/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_postgres.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/.env --project-name roottestpostgresqlreplicadatabaseengine1-gw0 --file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/instance/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_postgres.yml stop --timeout 20] Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-node2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-node2-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-node1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-node1-1 Stopping Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Removing Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Removing Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Removing Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Removing Stderr: Container roottestreloadclientcertificate-gw9-node2-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-node2-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-node2-1 Removing Stderr: Container roottestreloadclientcertificate-gw9-node2-1 Removing Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Removing Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Removing Stderr: Container roottestreloadclientcertificate-gw9-node1-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-node1-1 Stopped Stderr: Container roottestreloadclientcertificate-gw9-node1-1 Removing Stderr: Container roottestreloadclientcertificate-gw9-node1-1 Removing Stderr: Container roottestreloadclientcertificate-gw9-node2-1 Removed Stderr: Container roottestreloadclientcertificate-gw9-node2-1 Removed Stderr: Container roottestreloadclientcertificate-gw9-node1-1 Removed Stderr: Container roottestreloadclientcertificate-gw9-node1-1 Removed Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Removed Stderr: Container roottestreloadclientcertificate-gw9-zoo2-1 Removed Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Removed Stderr: Container roottestreloadclientcertificate-gw9-zoo3-1 Removed Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Removed Stderr: Container roottestreloadclientcertificate-gw9-zoo1-1 Removed Stderr: Network roottestreloadclientcertificate-gw9_default Removing Stderr: Network roottestreloadclientcertificate-gw9_default Removing Stderr: Network roottestreloadclientcertificate-gw9_default Removed Stderr: Network roottestreloadclientcertificate-gw9_default Removed Cleanup called Cleanup called http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None Docker networks for project roottestreloadclientcertificate-gw9 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreloadclientcertificate-gw9 are NETWORK ID NAME DRIVER SCOPE http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None Docker containers for project roottestreloadclientcertificate-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreloadclientcertificate-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreloadclientcertificate-gw9 are DRIVER VOLUME NAME Docker volumes for project roottestreloadclientcertificate-gw9 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreloadclientcertificate-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreloadclientcertificate-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreloadclientcertificate-gw9 No running containers for project: roottestreloadclientcertificate-gw9 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:4 Stdout:4 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 4 Volumes pruned: 4 test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys Running tests in /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/test.py Running tests in /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottestreplicatedmergetreeencrypteddisk-gw9 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedmergetreeencrypteddisk-gw9 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicatedmergetreeencrypteddisk-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedmergetreeencrypteddisk-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicatedmergetreeencrypteddisk-gw9 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedmergetreeencrypteddisk-gw9 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottestreplicatedmergetreeencrypteddisk-gw9 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedmergetreeencrypteddisk-gw9 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicatedmergetreeencrypteddisk-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedmergetreeencrypteddisk-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicatedmergetreeencrypteddisk-gw9 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedmergetreeencrypteddisk-gw9 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreplicatedmergetreeencrypteddisk-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreplicatedmergetreeencrypteddisk-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicatedmergetreeencrypteddisk-gw9 No running containers for project: roottestreplicatedmergetreeencrypteddisk-gw9 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:4 Stdout:4 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 4 Volumes pruned: 4 Setup directory for instance: node1 Setup directory for instance: node1 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/configs/storage.xml'] to /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node1/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/configs/storage.xml'] to /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node1/configs/config.d Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node1/database Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node1/database Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node1/logs Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node1/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Setup directory for instance: node2 Setup directory for instance: node2 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/configs/storage.xml'] to /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node2/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/configs/remote_servers.xml', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/configs/storage.xml'] to /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node2/configs/config.d Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node2/database Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node2/database Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node2/logs Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node2/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/.env --project-name roottestreplicatedmergetreeencrypteddisk-gw9 --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node2/docker-compose.yml pull] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/.env --project-name roottestreplicatedmergetreeencrypteddisk-gw9 --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node2/docker-compose.yml pull] Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-postgres1-1 Stopping Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-postgres1-1 Stopping Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 Stopping Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 Stopping Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-postgres1-1 Stopped Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-postgres1-1 Stopped Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 Stopped Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/instance/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/instance/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/instance/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/instance/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/.env --project-name roottestpostgresqlreplicadatabaseengine1-gw0 --file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/instance/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_postgres.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/.env --project-name roottestpostgresqlreplicadatabaseengine1-gw0 --file /ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/_instances-0-gw0/instance/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_postgres.yml down --volumes] Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 Stopping Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 Stopping Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-postgres1-1 Stopping Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-postgres1-1 Stopping Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 Stopped Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 Stopped Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 Removing Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 Removing Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-postgres1-1 Stopped Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-postgres1-1 Stopped Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-postgres1-1 Removing Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-postgres1-1 Removing Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 Removed Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-instance-1 Removed Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-postgres1-1 Removed Stderr: Container roottestpostgresqlreplicadatabaseengine1-gw0-postgres1-1 Removed Stderr: Network roottestpostgresqlreplicadatabaseengine1-gw0_default Removing Stderr: Network roottestpostgresqlreplicadatabaseengine1-gw0_default Removing Stderr: Network roottestpostgresqlreplicadatabaseengine1-gw0_default Removed Stderr: Network roottestpostgresqlreplicadatabaseengine1-gw0_default Removed Cleanup called Cleanup called Docker networks for project roottestpostgresqlreplicadatabaseengine1-gw0 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestpostgresqlreplicadatabaseengine1-gw0 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestpostgresqlreplicadatabaseengine1-gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestpostgresqlreplicadatabaseengine1-gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestpostgresqlreplicadatabaseengine1-gw0 are DRIVER VOLUME NAME Docker volumes for project roottestpostgresqlreplicadatabaseengine1-gw0 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestpostgresqlreplicadatabaseengine1-gw0-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestpostgresqlreplicadatabaseengine1-gw0-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestpostgresqlreplicadatabaseengine1-gw0 No running containers for project: roottestpostgresqlreplicadatabaseengine1-gw0 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:3 Stdout:3 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 3 Volumes pruned: 3 http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None Stderr: zoo1 Skipped - Image is already being pulled by ch1 Stderr: zoo1 Skipped - Image is already being pulled by ch1 Stderr: zoo2 Skipped - Image is already being pulled by ch1 Stderr: zoo2 Skipped - Image is already being pulled by ch1 Stderr: zoo3 Skipped - Image is already being pulled by ch1 Stderr: zoo3 Skipped - Image is already being pulled by ch1 Stderr: resolver Pulling Stderr: resolver Pulling Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: minio1 Pulling Stderr: minio1 Pulling Stderr: proxy1 Pulling Stderr: proxy1 Pulling Stderr: ch1 Pulling Stderr: ch1 Pulling Stderr: minio1 Pulled Stderr: minio1 Pulled Stderr: ch1 Pulled Stderr: ch1 Pulled Stderr: proxy1 Pulled Stderr: proxy1 Pulled Stderr: resolver Pulled Stderr: resolver Pulled Setup ZooKeeper Setup ZooKeeper Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper1/log', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper1/config', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper1/coordination', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper2/log', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper2/config', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper2/coordination', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper3/log', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper3/config', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper3/coordination'] Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper1/log', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper1/config', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper1/coordination', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper2/log', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper2/config', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper2/coordination', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper3/log', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper3/config', '/ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/keeper3/coordination'] Command:[docker compose --project-name roottestremovestalemovingparts-gw1 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Command:[docker compose --project-name roottestremovestalemovingparts-gw1 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Stderr: node2 Skipped - Image is already being pulled by zoo3 Stderr: node2 Skipped - Image is already being pulled by zoo3 Stderr: node1 Skipped - Image is already being pulled by zoo3 Stderr: node1 Skipped - Image is already being pulled by zoo3 Stderr: zoo1 Skipped - Image is already being pulled by zoo3 Stderr: zoo1 Skipped - Image is already being pulled by zoo3 Stderr: zoo2 Skipped - Image is already being pulled by zoo3 Stderr: zoo2 Skipped - Image is already being pulled by zoo3 Stderr: zoo3 Pulling Stderr: zoo3 Pulling Stderr: zoo3 Pulled Stderr: zoo3 Pulled Setup ZooKeeper Setup ZooKeeper Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper1/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper1/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper1/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper2/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper2/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper2/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper3/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper3/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper3/coordination'] Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper1/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper1/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper1/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper2/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper2/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper2/coordination', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper3/log', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper3/config', '/ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/keeper3/coordination'] Command:[docker compose --project-name roottestreplicatedmergetreeencrypteddisk-gw9 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Command:[docker compose --project-name roottestreplicatedmergetreeencrypteddisk-gw9 --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] Stderr:time="2025-04-02T02:57:15Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:57:15Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestremovestalemovingparts-gw1_default Creating Stderr: Network roottestremovestalemovingparts-gw1_default Creating Stderr: Network roottestremovestalemovingparts-gw1_default Created Stderr: Network roottestremovestalemovingparts-gw1_default Created Stderr: Container roottestremovestalemovingparts-gw1-zoo3-1 Creating Stderr: Container roottestremovestalemovingparts-gw1-zoo3-1 Creating Stderr: Container roottestremovestalemovingparts-gw1-zoo1-1 Creating Stderr: Container roottestremovestalemovingparts-gw1-zoo1-1 Creating Stderr: Container roottestremovestalemovingparts-gw1-zoo2-1 Creating Stderr: Container roottestremovestalemovingparts-gw1-zoo2-1 Creating Stderr: Container roottestremovestalemovingparts-gw1-zoo1-1 Created Stderr: Container roottestremovestalemovingparts-gw1-zoo1-1 Created Stderr: Container roottestremovestalemovingparts-gw1-zoo3-1 Created Stderr: Container roottestremovestalemovingparts-gw1-zoo3-1 Created Stderr: Container roottestremovestalemovingparts-gw1-zoo2-1 Created Stderr: Container roottestremovestalemovingparts-gw1-zoo2-1 Created Stderr: Container roottestremovestalemovingparts-gw1-zoo3-1 Starting Stderr: Container roottestremovestalemovingparts-gw1-zoo3-1 Starting Stderr: Container roottestremovestalemovingparts-gw1-zoo1-1 Starting Stderr: Container roottestremovestalemovingparts-gw1-zoo1-1 Starting Stderr: Container roottestremovestalemovingparts-gw1-zoo2-1 Starting Stderr: Container roottestremovestalemovingparts-gw1-zoo2-1 Starting Stderr: Container roottestremovestalemovingparts-gw1-zoo2-1 Started Stderr: Container roottestremovestalemovingparts-gw1-zoo2-1 Started Stderr: Container roottestremovestalemovingparts-gw1-zoo3-1 Started Stderr: Container roottestremovestalemovingparts-gw1-zoo3-1 Started Stderr: Container roottestremovestalemovingparts-gw1-zoo1-1 Started Stderr: Container roottestremovestalemovingparts-gw1-zoo1-1 Started Stderr:time="2025-04-02T02:57:16Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:57:16Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:57:16Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:57:16Z" level=debug msg="otel error" error="" Wait ZooKeeper to start Wait ZooKeeper to start get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw1-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw1-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.3.2, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.3.2, port:2181, use_ssl:False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/logs?stderr=1&stdout=1×tamps=0&follow=0&tail=all HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottests3storageconfnewproxy-gw5-proxy1-1/json HTTP/1.1" 200 None Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Stderr:time="2025-04-02T02:57:15Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:57:15Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestreplicatedmergetreeencrypteddisk-gw9_default Creating Stderr: Network roottestreplicatedmergetreeencrypteddisk-gw9_default Creating Stderr: Network roottestreplicatedmergetreeencrypteddisk-gw9_default Created Stderr: Network roottestreplicatedmergetreeencrypteddisk-gw9_default Created Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo1-1 Creating Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo1-1 Creating Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo3-1 Creating Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo3-1 Creating Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo2-1 Creating Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo2-1 Creating Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo1-1 Created Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo1-1 Created Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo2-1 Created Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo2-1 Created Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo3-1 Created Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo3-1 Created Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo1-1 Starting Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo1-1 Starting Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo2-1 Starting Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo2-1 Starting Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo3-1 Starting Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo3-1 Starting Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo3-1 Started Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo3-1 Started Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo2-1 Started Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo2-1 Started Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo1-1 Started Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo1-1 Started Stderr:time="2025-04-02T02:57:16Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:57:16Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:57:16Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:57:16Z" level=debug msg="otel error" error="" Wait ZooKeeper to start Wait ZooKeeper to start get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw9-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw9-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.4.2, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.4.2, port:2181, use_ssl:False Connecting to 172.16.4.2(172.16.4.2):2181, use_ssl: False Connecting to 172.16.4.2(172.16.4.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.4.2(172.16.4.2):2181, use_ssl: False Connecting to 172.16.4.2(172.16.4.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.4.2(172.16.4.2):2181, use_ssl: False Connecting to 172.16.4.2(172.16.4.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.4.2(172.16.4.2):2181, use_ssl: False Connecting to 172.16.4.2(172.16.4.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/.env --project-name roottests3storageconfnewproxy-gw5 --file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/.env --project-name roottests3storageconfnewproxy-gw5 --file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] [gw5] PASSED test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3] Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.4.2(172.16.4.2):2181, use_ssl: False Connecting to 172.16.4.2(172.16.4.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.4.2(172.16.4.2):2181, use_ssl: False Connecting to 172.16.4.2(172.16.4.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw1-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw1-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.3.4, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.3.4, port:2181, use_ssl:False Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw1-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw1-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.3.3, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.3.3, port:2181, use_ssl:False Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') Trying to create Minio instance by command docker compose --project-name roottestremovestalemovingparts-gw1 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Trying to create Minio instance by command docker compose --project-name roottestremovestalemovingparts-gw1 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Command:[docker compose --project-name roottestremovestalemovingparts-gw1 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Command:[docker compose --project-name roottestremovestalemovingparts-gw1 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Stderr:time="2025-04-02T02:57:21Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:57:21Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Volume "roottestremovestalemovingparts-gw1_data1-1" Creating Stderr: Volume "roottestremovestalemovingparts-gw1_data1-1" Creating Stderr: Volume "roottestremovestalemovingparts-gw1_data1-1" Created Stderr: Volume "roottestremovestalemovingparts-gw1_data1-1" Created Stderr:time="2025-04-02T02:57:21Z" level=warning msg="Found orphan containers ([roottestremovestalemovingparts-gw1-zoo2-1 roottestremovestalemovingparts-gw1-zoo1-1 roottestremovestalemovingparts-gw1-zoo3-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up." Stderr:time="2025-04-02T02:57:21Z" level=warning msg="Found orphan containers ([roottestremovestalemovingparts-gw1-zoo2-1 roottestremovestalemovingparts-gw1-zoo1-1 roottestremovestalemovingparts-gw1-zoo3-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up." Stderr: Container roottestremovestalemovingparts-gw1-proxy2-1 Creating Stderr: Container roottestremovestalemovingparts-gw1-proxy2-1 Creating Stderr: Container roottestremovestalemovingparts-gw1-proxy1-1 Creating Stderr: Container roottestremovestalemovingparts-gw1-proxy1-1 Creating Stderr: Container roottestremovestalemovingparts-gw1-proxy2-1 Created Stderr: Container roottestremovestalemovingparts-gw1-proxy2-1 Created Stderr: Container roottestremovestalemovingparts-gw1-proxy1-1 Created Stderr: Container roottestremovestalemovingparts-gw1-proxy1-1 Created Stderr: Container roottestremovestalemovingparts-gw1-minio1-1 Creating Stderr: Container roottestremovestalemovingparts-gw1-minio1-1 Creating Stderr: Container roottestremovestalemovingparts-gw1-resolver-1 Creating Stderr: Container roottestremovestalemovingparts-gw1-resolver-1 Creating Stderr: Container roottestremovestalemovingparts-gw1-resolver-1 Created Stderr: Container roottestremovestalemovingparts-gw1-resolver-1 Created Stderr: Container roottestremovestalemovingparts-gw1-minio1-1 Created Stderr: Container roottestremovestalemovingparts-gw1-minio1-1 Created Stderr: Container roottestremovestalemovingparts-gw1-proxy2-1 Starting Stderr: Container roottestremovestalemovingparts-gw1-proxy2-1 Starting Stderr: Container roottestremovestalemovingparts-gw1-proxy1-1 Starting Stderr: Container roottestremovestalemovingparts-gw1-proxy1-1 Starting Stderr: Container roottestremovestalemovingparts-gw1-proxy1-1 Started Stderr: Container roottestremovestalemovingparts-gw1-proxy1-1 Started Stderr: Container roottestremovestalemovingparts-gw1-proxy2-1 Started Stderr: Container roottestremovestalemovingparts-gw1-proxy2-1 Started Stderr: Container roottestremovestalemovingparts-gw1-resolver-1 Starting Stderr: Container roottestremovestalemovingparts-gw1-resolver-1 Starting Stderr: Container roottestremovestalemovingparts-gw1-minio1-1 Starting Stderr: Container roottestremovestalemovingparts-gw1-minio1-1 Starting Stderr: Container roottestremovestalemovingparts-gw1-resolver-1 Started Stderr: Container roottestremovestalemovingparts-gw1-resolver-1 Started Stderr: Container roottestremovestalemovingparts-gw1-minio1-1 Started Stderr: Container roottestremovestalemovingparts-gw1-minio1-1 Started Stderr:time="2025-04-02T02:57:22Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:57:22Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:57:22Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:57:22Z" level=debug msg="otel error" error="" Trying to connect to Minio... Trying to connect to Minio... get_instance_ip instance_name=minio1 get_instance_ip instance_name=minio1 http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw1-minio1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw1-minio1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy1 get_instance_ip instance_name=proxy1 http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw1-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw1-proxy1-1/json HTTP/1.1" 200 None Starting new HTTP connection (1): 172.16.3.8:9001 Starting new HTTP connection (1): 172.16.3.8:9001 Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (2): 172.16.3.8:9001 Starting new HTTP connection (2): 172.16.3.8:9001 Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (3): 172.16.3.8:9001 Starting new HTTP connection (3): 172.16.3.8:9001 Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (4): 172.16.3.8:9001 Starting new HTTP connection (4): 172.16.3.8:9001 Can't connect to Minio: HTTPConnectionPool(host='172.16.3.8', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Can't connect to Minio: HTTPConnectionPool(host='172.16.3.8', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Connecting to 172.16.4.2(172.16.4.2):2181, use_ssl: False Connecting to 172.16.4.2(172.16.4.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw9-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw9-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.4.3, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.4.3, port:2181, use_ssl:False Connecting to 172.16.4.3(172.16.4.3):2181, use_ssl: False Connecting to 172.16.4.3(172.16.4.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw9-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw9-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.4.4, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.4.4, port:2181, use_ssl:False Connecting to 172.16.4.4(172.16.4.4):2181, use_ssl: False Connecting to 172.16.4.4(172.16.4.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['keeper'] Received response(xid=1): ['keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/.env --project-name roottestreplicatedmergetreeencrypteddisk-gw9 --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node2/docker-compose.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/.env --project-name roottestreplicatedmergetreeencrypteddisk-gw9 --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node2/docker-compose.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/.env --project-name roottestreplicatedmergetreeencrypteddisk-gw9 --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node2/docker-compose.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/.env --project-name roottestreplicatedmergetreeencrypteddisk-gw9 --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node2/docker-compose.yml up -d --no-recreate] Starting new HTTP connection (5): 172.16.3.8:9001 Starting new HTTP connection (5): 172.16.3.8:9001 http://172.16.3.8:9001 "GET / HTTP/1.1" 200 0 http://172.16.3.8:9001 "GET / HTTP/1.1" 200 0 Connected to Minio. Connected to Minio. http://172.16.3.8:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.3.8:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.3.8:9001 "PUT /root HTTP/1.1" 200 0 http://172.16.3.8:9001 "PUT /root HTTP/1.1" 200 0 S3 bucket 'root' created S3 bucket 'root' created http://172.16.3.8:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.3.8:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.3.8:9001 "PUT /root2 HTTP/1.1" 200 0 http://172.16.3.8:9001 "PUT /root2 HTTP/1.1" 200 0 S3 bucket 'root2' created S3 bucket 'root2' created ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/.env --project-name roottestremovestalemovingparts-gw1 --file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/ch1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/.env --project-name roottestremovestalemovingparts-gw1 --file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/ch1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/.env --project-name roottestremovestalemovingparts-gw1 --file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/ch1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/.env --project-name roottestremovestalemovingparts-gw1 --file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/ch1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo2-1 Running Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo2-1 Running Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo3-1 Running Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo3-1 Running Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo1-1 Running Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo1-1 Running Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node2-1 Creating Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node2-1 Creating Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node1-1 Creating Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node1-1 Creating Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node2-1 Created Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node2-1 Created Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node1-1 Created Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node1-1 Created Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node1-1 Starting Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node1-1 Starting Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node2-1 Starting Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node2-1 Starting Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node2-1 Started Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node2-1 Started Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node1-1 Started Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node1-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw9-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw9-node1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node1 get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw9-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw9-node1-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node1, ip: 172.16.4.5... Waiting for ClickHouse start in node1, ip: 172.16.4.5... http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw9-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw9-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None Stderr: Container roottestremovestalemovingparts-gw1-proxy2-1 Running Stderr: Container roottestremovestalemovingparts-gw1-proxy2-1 Running Stderr: Container roottestremovestalemovingparts-gw1-zoo3-1 Running Stderr: Container roottestremovestalemovingparts-gw1-zoo3-1 Running Stderr: Container roottestremovestalemovingparts-gw1-zoo1-1 Running Stderr: Container roottestremovestalemovingparts-gw1-zoo1-1 Running Stderr: Container roottestremovestalemovingparts-gw1-zoo2-1 Running Stderr: Container roottestremovestalemovingparts-gw1-zoo2-1 Running Stderr: Container roottestremovestalemovingparts-gw1-proxy1-1 Running Stderr: Container roottestremovestalemovingparts-gw1-proxy1-1 Running Stderr: Container roottestremovestalemovingparts-gw1-minio1-1 Running Stderr: Container roottestremovestalemovingparts-gw1-minio1-1 Running Stderr: Container roottestremovestalemovingparts-gw1-resolver-1 Running Stderr: Container roottestremovestalemovingparts-gw1-resolver-1 Running Stderr: Container roottestremovestalemovingparts-gw1-ch1-1 Creating Stderr: Container roottestremovestalemovingparts-gw1-ch1-1 Creating Stderr: Container roottestremovestalemovingparts-gw1-ch1-1 Created Stderr: Container roottestremovestalemovingparts-gw1-ch1-1 Created Stderr: Container roottestremovestalemovingparts-gw1-ch1-1 Starting Stderr: Container roottestremovestalemovingparts-gw1-ch1-1 Starting Stderr: Container roottestremovestalemovingparts-gw1-ch1-1 Started Stderr: Container roottestremovestalemovingparts-gw1-ch1-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=ch1 get_instance_ip instance_name=ch1 http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw1-ch1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw1-ch1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=ch1 get_instance_ip instance_name=ch1 http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw1-ch1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw1-ch1-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in ch1, ip: 172.16.3.9... Waiting for ClickHouse start in ch1, ip: 172.16.3.9... http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw1-ch1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw1-ch1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/28ae8302aa941e64853019c0c3cb22680f413717031daac917a124bf433c7179/json HTTP/1.1" 200 None ClickHouse node1 started ClickHouse node1 started get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw9-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw9-node2-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node2 get_instance_ip instance_name=node2 http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw9-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw9-node2-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node2, ip: 172.16.4.6... Waiting for ClickHouse start in node2, ip: 172.16.4.6... http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw9-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestreplicatedmergetreeencrypteddisk-gw9-node2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b3103d94ade1ec18117a613f0f000d878a62bfcefd801e6eac99337111a5e6d4/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/b3103d94ade1ec18117a613f0f000d878a62bfcefd801e6eac99337111a5e6d4/json HTTP/1.1" 200 None ClickHouse node2 started ClickHouse node2 started run container_id:roottestreplicatedmergetreeencrypteddisk-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5hYWFhYWFhYWFhYWFhYWFhPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml'] run container_id:roottestreplicatedmergetreeencrypteddisk-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5hYWFhYWFhYWFhYWFhYWFhPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml'] Command:[docker exec roottestreplicatedmergetreeencrypteddisk-gw9-node1-1 bash -c mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5hYWFhYWFhYWFhYWFhYWFhPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml] Command:[docker exec roottestreplicatedmergetreeencrypteddisk-gw9-node1-1 bash -c mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5hYWFhYWFhYWFhYWFhYWFhPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml] Executing query SYSTEM RELOAD CONFIG on node1 Executing query SYSTEM RELOAD CONFIG on node1 http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d27374dae9ef7b435a9f15edef6e502ed566e8e0d0489a97e4cabc45338f256e/json HTTP/1.1" 200 None ClickHouse ch1 started ClickHouse ch1 started Executing query CREATE DATABASE IF NOT EXISTS stale_moving_parts on ch1 Executing query CREATE DATABASE IF NOT EXISTS stale_moving_parts on ch1 run container_id:roottestreplicatedmergetreeencrypteddisk-gw9-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5iYmJiYmJiYmJiYmJiYmJiPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml'] run container_id:roottestreplicatedmergetreeencrypteddisk-gw9-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5iYmJiYmJiYmJiYmJiYmJiPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml'] Command:[docker exec roottestreplicatedmergetreeencrypteddisk-gw9-node2-1 bash -c mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5iYmJiYmJiYmJiYmJiYmJiPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml] Command:[docker exec roottestreplicatedmergetreeencrypteddisk-gw9-node2-1 bash -c mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5iYmJiYmJiYmJiYmJiYmJiPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml] Executing query SYSTEM RELOAD CONFIG on node2 Executing query SYSTEM RELOAD CONFIG on node2 Executing query CREATE TABLE test_remove ON CLUSTER cluster ( id UInt32 ) ENGINE ReplicatedMergeTree() ORDER BY id; on ch1 Executing query CREATE TABLE test_remove ON CLUSTER cluster ( id UInt32 ) ENGINE ReplicatedMergeTree() ORDER BY id; on ch1 Executing query DROP TABLE IF EXISTS tbl ON CLUSTER 'cluster' SYNC on node1 Executing query DROP TABLE IF EXISTS tbl ON CLUSTER 'cluster' SYNC on node1 Executing query SELECT data_paths FROM system.tables WHERE table = 'test_remove' and database = 'stale_moving_parts' LIMIT 1 on ch1 Executing query SELECT data_paths FROM system.tables WHERE table = 'test_remove' and database = 'stale_moving_parts' LIMIT 1 on ch1 Executing query CREATE TABLE tbl ON CLUSTER 'cluster' ( id Int64, str String ) ENGINE=ReplicatedMergeTree('/clickhouse/tables/tbl/', '{replica}') ORDER BY id SETTINGS storage_policy='encrypted_policy' on node1 Executing query CREATE TABLE tbl ON CLUSTER 'cluster' ( id Int64, str String ) ENGINE=ReplicatedMergeTree('/clickhouse/tables/tbl/', '{replica}') ORDER BY id SETTINGS storage_policy='encrypted_policy' on node1 Executing query SYSTEM ENABLE FAILPOINT stop_moving_part_before_swap_with_active on ch1 Executing query SYSTEM ENABLE FAILPOINT stop_moving_part_before_swap_with_active on ch1 Executing query INSERT INTO test_remove SELECT number FROM numbers(100); on ch1 Executing query INSERT INTO test_remove SELECT number FROM numbers(100); on ch1 Executing query INSERT INTO tbl VALUES (1, 'str1') on node1 Executing query INSERT INTO tbl VALUES (1, 'str1') on node1 Executing query ALTER TABLE test_remove MOVE PART 'all_0_0_0' TO DISK 's3' on ch1 Executing query ALTER TABLE test_remove MOVE PART 'all_0_0_0' TO DISK 's3' on ch1 Executing query SELECT part_name FROM system.moves on ch1 Executing query SELECT part_name FROM system.moves on ch1 Executing query INSERT INTO tbl VALUES (1, 'str1') on node2 Executing query INSERT INTO tbl VALUES (1, 'str1') on node2 Executing query INSERT INTO tbl VALUES (2, 'str2') on node2 Executing query INSERT INTO tbl VALUES (2, 'str2') on node2 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node1 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node1 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node2 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node2 Executing query SELECT * FROM tbl ORDER BY id on node1 Executing query SELECT * FROM tbl ORDER BY id on node1 Executing query SELECT * FROM tbl ORDER BY id on node2 Executing query SELECT * FROM tbl ORDER BY id on node2 Executing query SELECT part_name FROM system.moves on ch1 Executing query SELECT part_name FROM system.moves on ch1 Executing query CHECK TABLE tbl on node1 Executing query CHECK TABLE tbl on node1 run container_id:roottestremovestalemovingparts-gw1-ch1-1 detach:False nothrow:False cmd: ['bash', '-c', 'ls /var/lib/clickhouse/disks/s3/store/17b/17b05ec6-e6dd-47a0-b74e-f9fb0829c9fd/moving'] run container_id:roottestremovestalemovingparts-gw1-ch1-1 detach:False nothrow:False cmd: ['bash', '-c', 'ls /var/lib/clickhouse/disks/s3/store/17b/17b05ec6-e6dd-47a0-b74e-f9fb0829c9fd/moving'] Command:[docker exec roottestremovestalemovingparts-gw1-ch1-1 bash -c ls /var/lib/clickhouse/disks/s3/store/17b/17b05ec6-e6dd-47a0-b74e-f9fb0829c9fd/moving] Command:[docker exec roottestremovestalemovingparts-gw1-ch1-1 bash -c ls /var/lib/clickhouse/disks/s3/store/17b/17b05ec6-e6dd-47a0-b74e-f9fb0829c9fd/moving] Stdout:all_0_0_0 Stdout:all_0_0_0 Stopping zookeeper node: zoo1 Stopping zookeeper node: zoo1 Command:[docker compose --project-name roottestremovestalemovingparts-gw1 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo1] Command:[docker compose --project-name roottestremovestalemovingparts-gw1 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo1] Executing query CHECK TABLE tbl on node2 Executing query CHECK TABLE tbl on node2 Executing query OPTIMIZE TABLE tbl ON CLUSTER 'cluster' FINAL on node1 Executing query OPTIMIZE TABLE tbl ON CLUSTER 'cluster' FINAL on node1 Connection dropped: socket connection error: None Connection dropped: socket connection error: None Stderr: Container roottestremovestalemovingparts-gw1-zoo1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-zoo1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-zoo1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-zoo1-1 Stopped Stopping zookeeper node: zoo2 Stopping zookeeper node: zoo2 Command:[docker compose --project-name roottestremovestalemovingparts-gw1 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo2] Command:[docker compose --project-name roottestremovestalemovingparts-gw1 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo2] Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node1 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node1 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node2 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node2 Executing query SELECT * FROM tbl ORDER BY id on node1 Executing query SELECT * FROM tbl ORDER BY id on node1 Executing query SELECT * FROM tbl ORDER BY id on node2 Executing query SELECT * FROM tbl ORDER BY id on node2 Executing query CHECK TABLE tbl on node1 Executing query CHECK TABLE tbl on node1 Executing query CHECK TABLE tbl on node2 Executing query CHECK TABLE tbl on node2 [gw9] PASSED test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys run container_id:roottestreplicatedmergetreeencrypteddisk-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5hYWFhYWFhYWFhYWFhYWFhPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml'] run container_id:roottestreplicatedmergetreeencrypteddisk-gw9-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5hYWFhYWFhYWFhYWFhYWFhPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml'] Command:[docker exec roottestreplicatedmergetreeencrypteddisk-gw9-node1-1 bash -c mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5hYWFhYWFhYWFhYWFhYWFhPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml] Command:[docker exec roottestreplicatedmergetreeencrypteddisk-gw9-node1-1 bash -c mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5hYWFhYWFhYWFhYWFhYWFhPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml] Executing query SYSTEM RELOAD CONFIG on node1 Executing query SYSTEM RELOAD CONFIG on node1 run container_id:roottestreplicatedmergetreeencrypteddisk-gw9-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5hYWFhYWFhYWFhYWFhYWFhPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml'] run container_id:roottestreplicatedmergetreeencrypteddisk-gw9-node2-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5hYWFhYWFhYWFhYWFhYWFhPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml'] Command:[docker exec roottestreplicatedmergetreeencrypteddisk-gw9-node2-1 bash -c mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5hYWFhYWFhYWFhYWFhYWFhPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml] Command:[docker exec roottestreplicatedmergetreeencrypteddisk-gw9-node2-1 bash -c mkdir -p $(dirname /etc/clickhouse-server/config.d/z_keys.xml) && echo PGNsaWNraG91c2U+CiAgICA8c3RvcmFnZV9jb25maWd1cmF0aW9uPgogICAgICAgIDxkaXNrcz4KICAgICAgICAgICAgPGRpc2tfZW5jcnlwdGVkPgogICAgICAgICAgICAgICAgPGtleT5hYWFhYWFhYWFhYWFhYWFhPC9rZXk+CiAgICAgICAgICAgIDwvZGlza19lbmNyeXB0ZWQ+CiAgICAgICAgPC9kaXNrcz4KICAgIDwvc3RvcmFnZV9jb25maWd1cmF0aW9uPgo8L2NsaWNraG91c2U+Cg== | base64 --decode > /etc/clickhouse-server/config.d/z_keys.xml] Executing query SYSTEM RELOAD CONFIG on node2 Executing query SYSTEM RELOAD CONFIG on node2 Executing query DROP TABLE IF EXISTS tbl ON CLUSTER 'cluster' SYNC on node1 Executing query DROP TABLE IF EXISTS tbl ON CLUSTER 'cluster' SYNC on node1 Executing query CREATE TABLE tbl ON CLUSTER 'cluster' ( id Int64, str String ) ENGINE=ReplicatedMergeTree('/clickhouse/tables/tbl/', '{replica}') ORDER BY id SETTINGS storage_policy='encrypted_policy' on node1 Executing query CREATE TABLE tbl ON CLUSTER 'cluster' ( id Int64, str String ) ENGINE=ReplicatedMergeTree('/clickhouse/tables/tbl/', '{replica}') ORDER BY id SETTINGS storage_policy='encrypted_policy' on node1 Executing query INSERT INTO tbl VALUES (1, 'str1') on node1 Executing query INSERT INTO tbl VALUES (1, 'str1') on node1 Executing query INSERT INTO tbl VALUES (1, 'str1') on node2 Executing query INSERT INTO tbl VALUES (1, 'str1') on node2 Executing query INSERT INTO tbl VALUES (2, 'str2') on node2 Executing query INSERT INTO tbl VALUES (2, 'str2') on node2 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node1 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node1 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node2 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node2 Executing query SELECT * FROM tbl ORDER BY id on node1 Executing query SELECT * FROM tbl ORDER BY id on node1 Executing query SELECT * FROM tbl ORDER BY id on node2 Executing query SELECT * FROM tbl ORDER BY id on node2 Executing query CHECK TABLE tbl on node1 Executing query CHECK TABLE tbl on node1 Executing query CHECK TABLE tbl on node2 Executing query CHECK TABLE tbl on node2 Executing query OPTIMIZE TABLE tbl ON CLUSTER 'cluster' FINAL on node1 Executing query OPTIMIZE TABLE tbl ON CLUSTER 'cluster' FINAL on node1 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node1 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node1 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node2 Executing query SYSTEM SYNC REPLICA tbl LIGHTWEIGHT on node2 Executing query SELECT * FROM tbl ORDER BY id on node1 Executing query SELECT * FROM tbl ORDER BY id on node1 Executing query SELECT * FROM tbl ORDER BY id on node2 Executing query SELECT * FROM tbl ORDER BY id on node2 Stderr: Container roottestremovestalemovingparts-gw1-zoo2-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-zoo2-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-zoo2-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-zoo2-1 Stopped Stopping zookeeper node: zoo3 Stopping zookeeper node: zoo3 Command:[docker compose --project-name roottestremovestalemovingparts-gw1 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo3] Command:[docker compose --project-name roottestremovestalemovingparts-gw1 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop zoo3] Executing query CHECK TABLE tbl on node1 Executing query CHECK TABLE tbl on node1 Executing query CHECK TABLE tbl on node2 Executing query CHECK TABLE tbl on node2 Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/.env --project-name roottestreplicatedmergetreeencrypteddisk-gw9 --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node2/docker-compose.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/.env --project-name roottestreplicatedmergetreeencrypteddisk-gw9 --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node2/docker-compose.yml stop --timeout 20] [gw9] PASSED test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys Stderr: Container roottests3storageconfnewproxy-gw5-resolver-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw5-resolver-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw5-node-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw5-node-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw5-node-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw5-node-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw5-minio1-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw5-minio1-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw5-minio1-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw5-minio1-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw5-resolver-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw5-resolver-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw5-proxy2-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw5-proxy2-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw5-proxy1-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw5-proxy1-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw5-proxy1-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw5-proxy1-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw5-proxy2-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw5-proxy2-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/.env --project-name roottests3storageconfnewproxy-gw5 --file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/.env --project-name roottests3storageconfnewproxy-gw5 --file /ClickHouse/tests/integration/test_s3_storage_conf_new_proxy/_instances-0-gw5/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Stderr: Container roottests3storageconfnewproxy-gw5-resolver-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw5-resolver-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw5-node-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw5-node-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw5-resolver-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw5-resolver-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw5-resolver-1 Removing Stderr: Container roottests3storageconfnewproxy-gw5-resolver-1 Removing Stderr: Container roottests3storageconfnewproxy-gw5-node-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw5-node-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw5-node-1 Removing Stderr: Container roottests3storageconfnewproxy-gw5-node-1 Removing Stderr: Container roottests3storageconfnewproxy-gw5-node-1 Removed Stderr: Container roottests3storageconfnewproxy-gw5-node-1 Removed Stderr: Container roottests3storageconfnewproxy-gw5-minio1-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw5-minio1-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw5-resolver-1 Removed Stderr: Container roottests3storageconfnewproxy-gw5-resolver-1 Removed Stderr: Container roottests3storageconfnewproxy-gw5-minio1-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw5-minio1-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw5-minio1-1 Removing Stderr: Container roottests3storageconfnewproxy-gw5-minio1-1 Removing Stderr: Container roottests3storageconfnewproxy-gw5-minio1-1 Removed Stderr: Container roottests3storageconfnewproxy-gw5-minio1-1 Removed Stderr: Container roottests3storageconfnewproxy-gw5-proxy2-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw5-proxy2-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw5-proxy1-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw5-proxy1-1 Stopping Stderr: Container roottests3storageconfnewproxy-gw5-proxy1-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw5-proxy1-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw5-proxy1-1 Removing Stderr: Container roottests3storageconfnewproxy-gw5-proxy1-1 Removing Stderr: Container roottests3storageconfnewproxy-gw5-proxy2-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw5-proxy2-1 Stopped Stderr: Container roottests3storageconfnewproxy-gw5-proxy2-1 Removing Stderr: Container roottests3storageconfnewproxy-gw5-proxy2-1 Removing Stderr: Container roottests3storageconfnewproxy-gw5-proxy1-1 Removed Stderr: Container roottests3storageconfnewproxy-gw5-proxy1-1 Removed Stderr: Container roottests3storageconfnewproxy-gw5-proxy2-1 Removed Stderr: Container roottests3storageconfnewproxy-gw5-proxy2-1 Removed Stderr: Volume roottests3storageconfnewproxy-gw5_data1-1 Removing Stderr: Volume roottests3storageconfnewproxy-gw5_data1-1 Removing Stderr: Network roottests3storageconfnewproxy-gw5_default Removing Stderr: Network roottests3storageconfnewproxy-gw5_default Removing Stderr: Volume roottests3storageconfnewproxy-gw5_data1-1 Removed Stderr: Volume roottests3storageconfnewproxy-gw5_data1-1 Removed Stderr: Network roottests3storageconfnewproxy-gw5_default Removed Stderr: Network roottests3storageconfnewproxy-gw5_default Removed Cleanup called Cleanup called Docker networks for project roottests3storageconfnewproxy-gw5 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3storageconfnewproxy-gw5 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3storageconfnewproxy-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3storageconfnewproxy-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3storageconfnewproxy-gw5 are DRIVER VOLUME NAME Docker volumes for project roottests3storageconfnewproxy-gw5 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3storageconfnewproxy-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottests3storageconfnewproxy-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3storageconfnewproxy-gw5 No running containers for project: roottests3storageconfnewproxy-gw5 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:3 Stdout:3 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 3 Volumes pruned: 3 Stderr: Container roottestremovestalemovingparts-gw1-zoo3-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-zoo3-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-zoo3-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-zoo3-1 Stopped Executing query SYSTEM STOP MOVES on ch1 Executing query SYSTEM STOP MOVES on ch1 Executing query SYSTEM DISABLE FAILPOINT stop_moving_part_before_swap_with_active on ch1 Executing query SYSTEM DISABLE FAILPOINT stop_moving_part_before_swap_with_active on ch1 run container_id:roottestremovestalemovingparts-gw1-ch1-1 detach:False nothrow:False cmd: ['bash', '-c', 'ls /var/lib/clickhouse/disks/s3/store/17b/17b05ec6-e6dd-47a0-b74e-f9fb0829c9fd/moving'] run container_id:roottestremovestalemovingparts-gw1-ch1-1 detach:False nothrow:False cmd: ['bash', '-c', 'ls /var/lib/clickhouse/disks/s3/store/17b/17b05ec6-e6dd-47a0-b74e-f9fb0829c9fd/moving'] Command:[docker exec roottestremovestalemovingparts-gw1-ch1-1 bash -c ls /var/lib/clickhouse/disks/s3/store/17b/17b05ec6-e6dd-47a0-b74e-f9fb0829c9fd/moving] Command:[docker exec roottestremovestalemovingparts-gw1-ch1-1 bash -c ls /var/lib/clickhouse/disks/s3/store/17b/17b05ec6-e6dd-47a0-b74e-f9fb0829c9fd/moving] Starting zookeeper node: zoo1 Starting zookeeper node: zoo1 Command:[docker compose --project-name roottestremovestalemovingparts-gw1 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo1] Command:[docker compose --project-name roottestremovestalemovingparts-gw1 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo1] Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node1-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node1-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node2-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node2-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node1-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node1-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node2-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node2-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo1-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo1-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo3-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo3-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/.env --project-name roottestreplicatedmergetreeencrypteddisk-gw9 --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node2/docker-compose.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/.env --project-name roottestreplicatedmergetreeencrypteddisk-gw9 --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_replicated_merge_tree_encrypted_disk/_instances-0-gw9/node2/docker-compose.yml down --volumes] Stderr: Container roottestremovestalemovingparts-gw1-zoo1-1 Starting Stderr: Container roottestremovestalemovingparts-gw1-zoo1-1 Starting Stderr: Container roottestremovestalemovingparts-gw1-zoo1-1 Started Stderr: Container roottestremovestalemovingparts-gw1-zoo1-1 Started Starting zookeeper node: zoo2 Starting zookeeper node: zoo2 Command:[docker compose --project-name roottestremovestalemovingparts-gw1 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo2] Command:[docker compose --project-name roottestremovestalemovingparts-gw1 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo2] Stderr: Container roottestremovestalemovingparts-gw1-zoo2-1 Starting Stderr: Container roottestremovestalemovingparts-gw1-zoo2-1 Starting Stderr: Container roottestremovestalemovingparts-gw1-zoo2-1 Started Stderr: Container roottestremovestalemovingparts-gw1-zoo2-1 Started Starting zookeeper node: zoo3 Starting zookeeper node: zoo3 Command:[docker compose --project-name roottestremovestalemovingparts-gw1 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo3] Command:[docker compose --project-name roottestremovestalemovingparts-gw1 --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml start zoo3] Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node2-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node2-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node1-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node1-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node2-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node2-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node2-1 Removing Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node2-1 Removing Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node1-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node1-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node1-1 Removing Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node1-1 Removing Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node1-1 Removed Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node1-1 Removed Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node2-1 Removed Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-node2-1 Removed Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo2-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo1-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo3-1 Stopping Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo2-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo2-1 Removing Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo2-1 Removing Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo1-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo1-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo1-1 Removing Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo1-1 Removing Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo3-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo3-1 Stopped Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo3-1 Removing Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo3-1 Removing Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo1-1 Removed Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo1-1 Removed Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo2-1 Removed Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo2-1 Removed Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo3-1 Removed Stderr: Container roottestreplicatedmergetreeencrypteddisk-gw9-zoo3-1 Removed Stderr: Network roottestreplicatedmergetreeencrypteddisk-gw9_default Removing Stderr: Network roottestreplicatedmergetreeencrypteddisk-gw9_default Removing Stderr: Network roottestreplicatedmergetreeencrypteddisk-gw9_default Removed Stderr: Network roottestreplicatedmergetreeencrypteddisk-gw9_default Removed Cleanup called Cleanup called Docker networks for project roottestreplicatedmergetreeencrypteddisk-gw9 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedmergetreeencrypteddisk-gw9 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicatedmergetreeencrypteddisk-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedmergetreeencrypteddisk-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicatedmergetreeencrypteddisk-gw9 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedmergetreeencrypteddisk-gw9 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreplicatedmergetreeencrypteddisk-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreplicatedmergetreeencrypteddisk-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicatedmergetreeencrypteddisk-gw9 No running containers for project: roottestreplicatedmergetreeencrypteddisk-gw9 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:3 Stdout:3 Command:[docker volume prune -f] Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Volumes pruned: 3 Volumes pruned: 3 Stderr: Container roottestremovestalemovingparts-gw1-zoo3-1 Starting Stderr: Container roottestremovestalemovingparts-gw1-zoo3-1 Starting Stderr: Container roottestremovestalemovingparts-gw1-zoo3-1 Started Stderr: Container roottestremovestalemovingparts-gw1-zoo3-1 Started get_instance_ip instance_name=zoo1 get_instance_ip instance_name=zoo1 http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw1-zoo1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw1-zoo1-1/json HTTP/1.1" 200 None get_kazoo_client: zoo1, ip:172.16.3.2, port:2181, use_ssl:False get_kazoo_client: zoo1, ip:172.16.3.2, port:2181, use_ssl:False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['clickhouse', 'keeper'] Received response(xid=1): ['clickhouse', 'keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo2 get_instance_ip instance_name=zoo2 http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw1-zoo2-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw1-zoo2-1/json HTTP/1.1" 200 None get_kazoo_client: zoo2, ip:172.16.3.3, port:2181, use_ssl:False get_kazoo_client: zoo2, ip:172.16.3.3, port:2181, use_ssl:False Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['clickhouse', 'keeper'] Received response(xid=1): ['clickhouse', 'keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED get_instance_ip instance_name=zoo3 get_instance_ip instance_name=zoo3 http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw1-zoo3-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestremovestalemovingparts-gw1-zoo3-1/json HTTP/1.1" 200 None get_kazoo_client: zoo3, ip:172.16.3.4, port:2181, use_ssl:False get_kazoo_client: zoo3, ip:172.16.3.4, port:2181, use_ssl:False Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) Zookeeper connection established, state: CONNECTED Zookeeper connection established, state: CONNECTED Sending request(xid=1): GetChildren(path='/', watcher=None) Sending request(xid=1): GetChildren(path='/', watcher=None) Received response(xid=1): ['clickhouse', 'keeper'] Received response(xid=1): ['clickhouse', 'keeper'] Sending request(xid=2): Close() Sending request(xid=2): Close() Connection dropped: socket connection broken Connection dropped: socket connection broken Transition to CONNECTING Transition to CONNECTING Zookeeper connection lost Zookeeper connection lost Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Zookeeper session closed, state: CLOSED Zookeeper session closed, state: CLOSED All instances of ZooKeeper started: ['zoo1', 'zoo2', 'zoo3'] All instances of ZooKeeper started: ['zoo1', 'zoo2', 'zoo3'] Executing query SYSTEM START MOVES on ch1 Executing query SYSTEM START MOVES on ch1 Executing query DROP TABLE test_remove on ch1 Executing query DROP TABLE test_remove on ch1 Command:[docker compose --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/.env --project-name roottestremovestalemovingparts-gw1 --file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/ch1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/.env --project-name roottestremovestalemovingparts-gw1 --file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/ch1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] [gw1] PASSED test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper Connection dropped: socket connection error: None Connection dropped: socket connection error: None Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Connection dropped: socket connection error: Connection refused Connection dropped: socket connection error: Connection refused Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster2' and host_name='node_1' on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster2' and host_name='node_1' on node run container_id:roottestreloadclustersconfig-gw8-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo '\n\n \n \n \n true\n \n node_1\n 9000\n \n \n node_2\n 9000\n \n \n \n \n\n' > /etc/clickhouse-server/config.d/remote_servers.xml"] run container_id:roottestreloadclustersconfig-gw8-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo '\n\n \n \n \n true\n \n node_1\n 9000\n \n \n node_2\n 9000\n \n \n \n \n\n' > /etc/clickhouse-server/config.d/remote_servers.xml"] Command:[docker exec roottestreloadclustersconfig-gw8-node-1 bash -c echo ' true node_1 9000 node_2 9000 ' > /etc/clickhouse-server/config.d/remote_servers.xml] Command:[docker exec roottestreloadclustersconfig-gw8-node-1 bash -c echo ' true node_1 9000 node_2 9000 ' > /etc/clickhouse-server/config.d/remote_servers.xml] Executing query SYSTEM RELOAD CONFIG on node Executing query SYSTEM RELOAD CONFIG on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node Executing query SELECT * FROM system.clusters WHERE cluster='test_cluster2' on node Executing query SELECT * FROM system.clusters WHERE cluster='test_cluster2' on node run container_id:roottestreloadclustersconfig-gw8-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo '\n\n \n \n \n true\n \n node_1\n 9000\n \n \n node_2\n 9000\n \n \n \n \n \n true\n \n node_1\n 9000\n \n \n node_2\n 9000\n \n \n \n \n\n' > /etc/clickhouse-server/config.d/remote_servers.xml"] run container_id:roottestreloadclustersconfig-gw8-node-1 detach:False nothrow:False cmd: ['bash', '-c', "echo '\n\n \n \n \n true\n \n node_1\n 9000\n \n \n node_2\n 9000\n \n \n \n \n \n true\n \n node_1\n 9000\n \n \n node_2\n 9000\n \n \n \n \n\n' > /etc/clickhouse-server/config.d/remote_servers.xml"] Command:[docker exec roottestreloadclustersconfig-gw8-node-1 bash -c echo ' true node_1 9000 node_2 9000 true node_1 9000 node_2 9000 ' > /etc/clickhouse-server/config.d/remote_servers.xml] Command:[docker exec roottestreloadclustersconfig-gw8-node-1 bash -c echo ' true node_1 9000 node_2 9000 true node_1 9000 node_2 9000 ' > /etc/clickhouse-server/config.d/remote_servers.xml] Executing query SYSTEM RELOAD CONFIG on node Executing query SYSTEM RELOAD CONFIG on node Stderr: Container roottestremovestalemovingparts-gw1-resolver-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-resolver-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-ch1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-ch1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-ch1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-ch1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-zoo1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-zoo1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-zoo2-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-zoo2-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-minio1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-minio1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-zoo3-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-zoo3-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-minio1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-minio1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-zoo3-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-zoo3-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-zoo1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-zoo1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-zoo2-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-zoo2-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-resolver-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-resolver-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-proxy1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-proxy1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-proxy2-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-proxy2-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-proxy2-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-proxy2-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-proxy1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-proxy1-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/ch1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/ch1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/ch1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/ch1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/.env --project-name roottestremovestalemovingparts-gw1 --file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/ch1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/.env --project-name roottestremovestalemovingparts-gw1 --file /ClickHouse/tests/integration/test_remove_stale_moving_parts/_instances-0-gw1/ch1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Stderr: Container roottestremovestalemovingparts-gw1-resolver-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-resolver-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-ch1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-ch1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-resolver-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-resolver-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-resolver-1 Removing Stderr: Container roottestremovestalemovingparts-gw1-resolver-1 Removing Stderr: Container roottestremovestalemovingparts-gw1-ch1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-ch1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-ch1-1 Removing Stderr: Container roottestremovestalemovingparts-gw1-ch1-1 Removing Stderr: Container roottestremovestalemovingparts-gw1-ch1-1 Removed Stderr: Container roottestremovestalemovingparts-gw1-ch1-1 Removed Stderr: Container roottestremovestalemovingparts-gw1-zoo3-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-zoo3-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-minio1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-minio1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-zoo1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-zoo1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-zoo2-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-zoo2-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-zoo3-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-zoo3-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-zoo3-1 Removing Stderr: Container roottestremovestalemovingparts-gw1-zoo3-1 Removing Stderr: Container roottestremovestalemovingparts-gw1-minio1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-minio1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-minio1-1 Removing Stderr: Container roottestremovestalemovingparts-gw1-minio1-1 Removing Stderr: Container roottestremovestalemovingparts-gw1-zoo1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-zoo1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-zoo1-1 Removing Stderr: Container roottestremovestalemovingparts-gw1-zoo1-1 Removing Stderr: Container roottestremovestalemovingparts-gw1-zoo2-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-zoo2-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-zoo2-1 Removing Stderr: Container roottestremovestalemovingparts-gw1-zoo2-1 Removing Stderr: Container roottestremovestalemovingparts-gw1-resolver-1 Removed Stderr: Container roottestremovestalemovingparts-gw1-resolver-1 Removed Stderr: Container roottestremovestalemovingparts-gw1-zoo3-1 Removed Stderr: Container roottestremovestalemovingparts-gw1-zoo3-1 Removed Stderr: Container roottestremovestalemovingparts-gw1-zoo1-1 Removed Stderr: Container roottestremovestalemovingparts-gw1-zoo1-1 Removed Stderr: Container roottestremovestalemovingparts-gw1-minio1-1 Removed Stderr: Container roottestremovestalemovingparts-gw1-minio1-1 Removed Stderr: Container roottestremovestalemovingparts-gw1-proxy1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-proxy1-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-proxy2-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-proxy2-1 Stopping Stderr: Container roottestremovestalemovingparts-gw1-zoo2-1 Removed Stderr: Container roottestremovestalemovingparts-gw1-zoo2-1 Removed Stderr: Container roottestremovestalemovingparts-gw1-proxy2-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-proxy2-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-proxy2-1 Removing Stderr: Container roottestremovestalemovingparts-gw1-proxy2-1 Removing Stderr: Container roottestremovestalemovingparts-gw1-proxy1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-proxy1-1 Stopped Stderr: Container roottestremovestalemovingparts-gw1-proxy1-1 Removing Stderr: Container roottestremovestalemovingparts-gw1-proxy1-1 Removing Stderr: Container roottestremovestalemovingparts-gw1-proxy1-1 Removed Stderr: Container roottestremovestalemovingparts-gw1-proxy1-1 Removed Stderr: Container roottestremovestalemovingparts-gw1-proxy2-1 Removed Stderr: Container roottestremovestalemovingparts-gw1-proxy2-1 Removed Stderr: Volume roottestremovestalemovingparts-gw1_data1-1 Removing Stderr: Volume roottestremovestalemovingparts-gw1_data1-1 Removing Stderr: Network roottestremovestalemovingparts-gw1_default Removing Stderr: Network roottestremovestalemovingparts-gw1_default Removing Stderr: Volume roottestremovestalemovingparts-gw1_data1-1 Removed Stderr: Volume roottestremovestalemovingparts-gw1_data1-1 Removed Stderr: Network roottestremovestalemovingparts-gw1_default Removed Stderr: Network roottestremovestalemovingparts-gw1_default Removed Cleanup called Cleanup called Docker networks for project roottestremovestalemovingparts-gw1 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestremovestalemovingparts-gw1 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestremovestalemovingparts-gw1 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestremovestalemovingparts-gw1 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestremovestalemovingparts-gw1 are DRIVER VOLUME NAME Docker volumes for project roottestremovestalemovingparts-gw1 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestremovestalemovingparts-gw1-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestremovestalemovingparts-gw1-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestremovestalemovingparts-gw1 No running containers for project: roottestremovestalemovingparts-gw1 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:1 Stdout:1 Volumes pruned: 1 Volumes pruned: 1 [gw8] PASSED test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Connection dropped: socket connection error: None Connection dropped: socket connection error: None Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: minio1 Pulling Stderr: minio1 Pulling Stderr: azurite1 Pulling Stderr: azurite1 Pulling Stderr: node Pulling Stderr: node Pulling Stderr: resolver Pulling Stderr: resolver Pulling Stderr: proxy1 Pulling Stderr: proxy1 Pulling Stderr: resolver Pulled Stderr: resolver Pulled Stderr: minio1 Pulled Stderr: minio1 Pulled Stderr: node Pulled Stderr: node Pulled Stderr: proxy1 Pulled Stderr: proxy1 Pulled Stderr: f18232174bc9 Pulling fs layer Stderr: f18232174bc9 Pulling fs layer Stderr: cb2bde55f71f Pulling fs layer Stderr: cb2bde55f71f Pulling fs layer Stderr: 9d0e0719fbe0 Pulling fs layer Stderr: 9d0e0719fbe0 Pulling fs layer Stderr: 6f063dbd7a5d Pulling fs layer Stderr: 6f063dbd7a5d Pulling fs layer Stderr: f9e3e3d8f042 Pulling fs layer Stderr: f9e3e3d8f042 Pulling fs layer Stderr: a39ef2f62dc8 Pulling fs layer Stderr: a39ef2f62dc8 Pulling fs layer Stderr: 9a21c6b23f0e Pulling fs layer Stderr: 9a21c6b23f0e Pulling fs layer Stderr: efeb7b313b67 Pulling fs layer Stderr: efeb7b313b67 Pulling fs layer Stderr: 6fef65209747 Pulling fs layer Stderr: 6fef65209747 Pulling fs layer Stderr: 3d377e512a83 Pulling fs layer Stderr: 3d377e512a83 Pulling fs layer Stderr: a39ef2f62dc8 Waiting Stderr: a39ef2f62dc8 Waiting Stderr: 9a21c6b23f0e Waiting Stderr: 9a21c6b23f0e Waiting Stderr: efeb7b313b67 Waiting Stderr: efeb7b313b67 Waiting Stderr: 6fef65209747 Waiting Stderr: 6fef65209747 Waiting Stderr: 3d377e512a83 Waiting Stderr: 3d377e512a83 Waiting Stderr: 6f063dbd7a5d Waiting Stderr: 6f063dbd7a5d Waiting Stderr: f9e3e3d8f042 Waiting Stderr: f9e3e3d8f042 Waiting Stderr: 9d0e0719fbe0 Downloading [> ] 15.58kB/1.261MB Stderr: 9d0e0719fbe0 Downloading [> ] 15.58kB/1.261MB Stderr: f18232174bc9 Downloading [> ] 48.34kB/3.642MB Stderr: f18232174bc9 Downloading [> ] 48.34kB/3.642MB Stderr: 9d0e0719fbe0 Downloading [===============> ] 391.5kB/1.261MB Stderr: 9d0e0719fbe0 Downloading [===============> ] 391.5kB/1.261MB Stderr: cb2bde55f71f Downloading [> ] 506.1kB/50.34MB Stderr: cb2bde55f71f Downloading [> ] 506.1kB/50.34MB Stderr: f18232174bc9 Downloading [========> ] 637.2kB/3.642MB Stderr: f18232174bc9 Downloading [========> ] 637.2kB/3.642MB Stderr: 9d0e0719fbe0 Verifying Checksum Stderr: 9d0e0719fbe0 Verifying Checksum Stderr: 9d0e0719fbe0 Download complete Stderr: 9d0e0719fbe0 Download complete Stderr: cb2bde55f71f Downloading [===> ] 3.046MB/50.34MB Stderr: cb2bde55f71f Downloading [===> ] 3.046MB/50.34MB Stderr: f18232174bc9 Downloading [=========================================> ] 3.046MB/3.642MB Stderr: f18232174bc9 Downloading [=========================================> ] 3.046MB/3.642MB Stderr: f18232174bc9 Verifying Checksum Stderr: f18232174bc9 Verifying Checksum Stderr: f18232174bc9 Download complete Stderr: f18232174bc9 Download complete Stderr: f18232174bc9 Extracting [> ] 65.54kB/3.642MB Stderr: f18232174bc9 Extracting [> ] 65.54kB/3.642MB Stderr: f18232174bc9 Extracting [==================================================>] 3.642MB/3.642MB Stderr: f18232174bc9 Extracting [==================================================>] 3.642MB/3.642MB Stderr: f18232174bc9 Extracting [==================================================>] 3.642MB/3.642MB Stderr: f18232174bc9 Extracting [==================================================>] 3.642MB/3.642MB Stderr: cb2bde55f71f Downloading [=======> ] 7.617MB/50.34MB Stderr: cb2bde55f71f Downloading [=======> ] 7.617MB/50.34MB Stderr: f18232174bc9 Pull complete Stderr: f18232174bc9 Pull complete Stderr: cb2bde55f71f Downloading [=================> ] 17.27MB/50.34MB Stderr: cb2bde55f71f Downloading [=================> ] 17.27MB/50.34MB Stderr: cb2bde55f71f Downloading [==============================> ] 30.47MB/50.34MB Stderr: cb2bde55f71f Downloading [==============================> ] 30.47MB/50.34MB Stderr: cb2bde55f71f Downloading [==========================================> ] 42.66MB/50.34MB Stderr: cb2bde55f71f Downloading [==========================================> ] 42.66MB/50.34MB Stderr: cb2bde55f71f Verifying Checksum Stderr: cb2bde55f71f Verifying Checksum Stderr: cb2bde55f71f Download complete Stderr: cb2bde55f71f Download complete Stderr: cb2bde55f71f Extracting [> ] 524.3kB/50.34MB Stderr: cb2bde55f71f Extracting [> ] 524.3kB/50.34MB Stderr: cb2bde55f71f Extracting [========> ] 8.913MB/50.34MB Stderr: cb2bde55f71f Extracting [========> ] 8.913MB/50.34MB Stderr: cb2bde55f71f Extracting [===================> ] 19.4MB/50.34MB Stderr: cb2bde55f71f Extracting [===================> ] 19.4MB/50.34MB Stderr: cb2bde55f71f Extracting [============================> ] 28.31MB/50.34MB Stderr: cb2bde55f71f Extracting [============================> ] 28.31MB/50.34MB Stderr: cb2bde55f71f Extracting [=======================================> ] 39.32MB/50.34MB Stderr: cb2bde55f71f Extracting [=======================================> ] 39.32MB/50.34MB Stderr: cb2bde55f71f Extracting [==============================================> ] 46.66MB/50.34MB Stderr: cb2bde55f71f Extracting [==============================================> ] 46.66MB/50.34MB Stderr: cb2bde55f71f Extracting [===============================================> ] 47.71MB/50.34MB Stderr: cb2bde55f71f Extracting [===============================================> ] 47.71MB/50.34MB Stderr: cb2bde55f71f Extracting [================================================> ] 48.76MB/50.34MB Stderr: cb2bde55f71f Extracting [================================================> ] 48.76MB/50.34MB Stderr: cb2bde55f71f Extracting [=================================================> ] 49.81MB/50.34MB Stderr: cb2bde55f71f Extracting [=================================================> ] 49.81MB/50.34MB Stderr: cb2bde55f71f Extracting [=================================================> ] 50.33MB/50.34MB Stderr: cb2bde55f71f Extracting [=================================================> ] 50.33MB/50.34MB Stderr: cb2bde55f71f Extracting [==================================================>] 50.34MB/50.34MB Stderr: cb2bde55f71f Extracting [==================================================>] 50.34MB/50.34MB Stderr: cb2bde55f71f Pull complete Stderr: cb2bde55f71f Pull complete Stderr: 9d0e0719fbe0 Extracting [=> ] 32.77kB/1.261MB Stderr: 9d0e0719fbe0 Extracting [=> ] 32.77kB/1.261MB Stderr: 9d0e0719fbe0 Extracting [==================================================>] 1.261MB/1.261MB Stderr: 9d0e0719fbe0 Extracting [==================================================>] 1.261MB/1.261MB Stderr: 9d0e0719fbe0 Extracting [==================================================>] 1.261MB/1.261MB Stderr: 9d0e0719fbe0 Extracting [==================================================>] 1.261MB/1.261MB Stderr: 9d0e0719fbe0 Pull complete Stderr: 9d0e0719fbe0 Pull complete Stderr: a39ef2f62dc8 Downloading [> ] 3.29kB/209.4kB Stderr: a39ef2f62dc8 Downloading [> ] 3.29kB/209.4kB Stderr: f9e3e3d8f042 Downloading [==================================================>] 116B/116B Stderr: f9e3e3d8f042 Downloading [==================================================>] 116B/116B Stderr: f9e3e3d8f042 Verifying Checksum Stderr: f9e3e3d8f042 Verifying Checksum Stderr: f9e3e3d8f042 Download complete Stderr: f9e3e3d8f042 Download complete Stderr: 6f063dbd7a5d Downloading [==================================================>] 446B/446B Stderr: 6f063dbd7a5d Downloading [==================================================>] 446B/446B Stderr: 6f063dbd7a5d Download complete Stderr: 6f063dbd7a5d Download complete Stderr: 6f063dbd7a5d Extracting [==================================================>] 446B/446B Stderr: 6f063dbd7a5d Extracting [==================================================>] 446B/446B Stderr: 6f063dbd7a5d Extracting [==================================================>] 446B/446B Stderr: 6f063dbd7a5d Extracting [==================================================>] 446B/446B Stderr: 6f063dbd7a5d Pull complete Stderr: 6f063dbd7a5d Pull complete Stderr: f9e3e3d8f042 Extracting [==================================================>] 116B/116B Stderr: f9e3e3d8f042 Extracting [==================================================>] 116B/116B Stderr: f9e3e3d8f042 Extracting [==================================================>] 116B/116B Stderr: f9e3e3d8f042 Extracting [==================================================>] 116B/116B Stderr: f9e3e3d8f042 Pull complete Stderr: f9e3e3d8f042 Pull complete Stderr: a39ef2f62dc8 Downloading [==================================================>] 209.4kB/209.4kB Stderr: a39ef2f62dc8 Downloading [==================================================>] 209.4kB/209.4kB Stderr: a39ef2f62dc8 Verifying Checksum Stderr: a39ef2f62dc8 Verifying Checksum Stderr: a39ef2f62dc8 Download complete Stderr: a39ef2f62dc8 Download complete Stderr: a39ef2f62dc8 Extracting [=======> ] 32.77kB/209.4kB Stderr: a39ef2f62dc8 Extracting [=======> ] 32.77kB/209.4kB Stderr: a39ef2f62dc8 Extracting [==================================================>] 209.4kB/209.4kB Stderr: a39ef2f62dc8 Extracting [==================================================>] 209.4kB/209.4kB Stderr: a39ef2f62dc8 Extracting [==================================================>] 209.4kB/209.4kB Stderr: a39ef2f62dc8 Extracting [==================================================>] 209.4kB/209.4kB Stderr: a39ef2f62dc8 Pull complete Stderr: a39ef2f62dc8 Pull complete Stderr: 9a21c6b23f0e Downloading [> ] 15.58kB/794kB Stderr: 9a21c6b23f0e Downloading [> ] 15.58kB/794kB Stderr: efeb7b313b67 Downloading [=> ] 15.58kB/458.8kB Stderr: efeb7b313b67 Downloading [=> ] 15.58kB/458.8kB Stderr: 9a21c6b23f0e Downloading [=====================> ] 342.3kB/794kB Stderr: 9a21c6b23f0e Downloading [=====================> ] 342.3kB/794kB Stderr: efeb7b313b67 Downloading [=======================================> ] 358.7kB/458.8kB Stderr: efeb7b313b67 Downloading [=======================================> ] 358.7kB/458.8kB Stderr: efeb7b313b67 Verifying Checksum Stderr: efeb7b313b67 Verifying Checksum Stderr: 6fef65209747 Downloading [> ] 375.1kB/36.34MB Stderr: 6fef65209747 Downloading [> ] 375.1kB/36.34MB Stderr: 9a21c6b23f0e Downloading [==================================================>] 794kB/794kB Stderr: 9a21c6b23f0e Downloading [==================================================>] 794kB/794kB Stderr: 9a21c6b23f0e Verifying Checksum Stderr: 9a21c6b23f0e Verifying Checksum Stderr: 9a21c6b23f0e Download complete Stderr: 9a21c6b23f0e Download complete Stderr: 9a21c6b23f0e Extracting [==> ] 32.77kB/794kB Stderr: 9a21c6b23f0e Extracting [==> ] 32.77kB/794kB Stderr: 6fef65209747 Downloading [==> ] 1.882MB/36.34MB Stderr: 6fef65209747 Downloading [==> ] 1.882MB/36.34MB Stderr: 9a21c6b23f0e Extracting [==============================> ] 491.5kB/794kB Stderr: 9a21c6b23f0e Extracting [==============================> ] 491.5kB/794kB Stderr: 6fef65209747 Downloading [========> ] 6.028MB/36.34MB Stderr: 6fef65209747 Downloading [========> ] 6.028MB/36.34MB Stderr: 9a21c6b23f0e Extracting [=================================================> ] 786.4kB/794kB Stderr: 9a21c6b23f0e Extracting [=================================================> ] 786.4kB/794kB Stderr: 9a21c6b23f0e Extracting [==================================================>] 794kB/794kB Stderr: 9a21c6b23f0e Extracting [==================================================>] 794kB/794kB Stderr: 9a21c6b23f0e Pull complete Stderr: 9a21c6b23f0e Pull complete Stderr: efeb7b313b67 Extracting [===> ] 32.77kB/458.8kB Stderr: efeb7b313b67 Extracting [===> ] 32.77kB/458.8kB Stderr: 6fef65209747 Downloading [===================> ] 13.94MB/36.34MB Stderr: 6fef65209747 Downloading [===================> ] 13.94MB/36.34MB Stderr: efeb7b313b67 Extracting [==================================================>] 458.8kB/458.8kB Stderr: efeb7b313b67 Extracting [==================================================>] 458.8kB/458.8kB Stderr: efeb7b313b67 Extracting [==================================================>] 458.8kB/458.8kB Stderr: efeb7b313b67 Extracting [==================================================>] 458.8kB/458.8kB Stderr: efeb7b313b67 Pull complete Stderr: efeb7b313b67 Pull complete Stderr: 6fef65209747 Downloading [=================================> ] 24.12MB/36.34MB Stderr: 6fef65209747 Downloading [=================================> ] 24.12MB/36.34MB Stderr: 6fef65209747 Downloading [================================================> ] 35.05MB/36.34MB Stderr: 6fef65209747 Downloading [================================================> ] 35.05MB/36.34MB Stderr: 6fef65209747 Download complete Stderr: 6fef65209747 Download complete Stderr: 6fef65209747 Extracting [> ] 393.2kB/36.34MB Stderr: 6fef65209747 Extracting [> ] 393.2kB/36.34MB Stderr: 6fef65209747 Extracting [=> ] 1.18MB/36.34MB Stderr: 6fef65209747 Extracting [=> ] 1.18MB/36.34MB Stderr: 6fef65209747 Extracting [==> ] 1.573MB/36.34MB Stderr: 6fef65209747 Extracting [==> ] 1.573MB/36.34MB Stderr: 6fef65209747 Extracting [===> ] 2.359MB/36.34MB Stderr: 6fef65209747 Extracting [===> ] 2.359MB/36.34MB Stderr: 6fef65209747 Extracting [====> ] 3.539MB/36.34MB Stderr: 6fef65209747 Extracting [====> ] 3.539MB/36.34MB Stderr: 6fef65209747 Extracting [=====> ] 3.932MB/36.34MB Stderr: 6fef65209747 Extracting [=====> ] 3.932MB/36.34MB Stderr: 6fef65209747 Extracting [=======> ] 5.505MB/36.34MB Stderr: 6fef65209747 Extracting [=======> ] 5.505MB/36.34MB Stderr: 6fef65209747 Extracting [========> ] 5.898MB/36.34MB Stderr: 6fef65209747 Extracting [========> ] 5.898MB/36.34MB Stderr: 6fef65209747 Extracting [=========> ] 6.685MB/36.34MB Stderr: 6fef65209747 Extracting [=========> ] 6.685MB/36.34MB Stderr: 6fef65209747 Extracting [==========> ] 7.471MB/36.34MB Stderr: 6fef65209747 Extracting [==========> ] 7.471MB/36.34MB Stderr: 6fef65209747 Extracting [==========> ] 7.864MB/36.34MB Stderr: 6fef65209747 Extracting [==========> ] 7.864MB/36.34MB Stderr: 6fef65209747 Extracting [===========> ] 8.258MB/36.34MB Stderr: 6fef65209747 Extracting [===========> ] 8.258MB/36.34MB Stderr: 6fef65209747 Extracting [===========> ] 8.651MB/36.34MB Stderr: 6fef65209747 Extracting [===========> ] 8.651MB/36.34MB Stderr: 6fef65209747 Extracting [=============> ] 9.83MB/36.34MB Stderr: 6fef65209747 Extracting [=============> ] 9.83MB/36.34MB Stderr: 6fef65209747 Extracting [=================> ] 12.98MB/36.34MB Stderr: 6fef65209747 Extracting [=================> ] 12.98MB/36.34MB Stderr: 6fef65209747 Extracting [==================> ] 13.76MB/36.34MB Stderr: 6fef65209747 Extracting [==================> ] 13.76MB/36.34MB Stderr: 6fef65209747 Extracting [====================> ] 14.94MB/36.34MB Stderr: 6fef65209747 Extracting [====================> ] 14.94MB/36.34MB Stderr: 6fef65209747 Extracting [=====================> ] 15.73MB/36.34MB Stderr: 6fef65209747 Extracting [=====================> ] 15.73MB/36.34MB Stderr: 6fef65209747 Extracting [======================> ] 16.12MB/36.34MB Stderr: 6fef65209747 Extracting [======================> ] 16.12MB/36.34MB Stderr: 6fef65209747 Extracting [=======================> ] 17.3MB/36.34MB Stderr: 6fef65209747 Extracting [=======================> ] 17.3MB/36.34MB Stderr: 6fef65209747 Extracting [============================> ] 20.84MB/36.34MB Stderr: 6fef65209747 Extracting [============================> ] 20.84MB/36.34MB Stderr: 6fef65209747 Extracting [========================================> ] 29.1MB/36.34MB Stderr: 6fef65209747 Extracting [========================================> ] 29.1MB/36.34MB Stderr: 6fef65209747 Extracting [==============================================> ] 33.82MB/36.34MB Stderr: 6fef65209747 Extracting [==============================================> ] 33.82MB/36.34MB Stderr: 6fef65209747 Extracting [==================================================>] 36.34MB/36.34MB Stderr: 6fef65209747 Extracting [==================================================>] 36.34MB/36.34MB Stderr: 6fef65209747 Pull complete Stderr: 6fef65209747 Pull complete Stderr: 3d377e512a83 Downloading [==================================================>] 2.862kB/2.862kB Stderr: 3d377e512a83 Downloading [==================================================>] 2.862kB/2.862kB Stderr: 3d377e512a83 Verifying Checksum Stderr: 3d377e512a83 Verifying Checksum Stderr: 3d377e512a83 Download complete Stderr: 3d377e512a83 Download complete Stderr: 3d377e512a83 Extracting [==================================================>] 2.862kB/2.862kB Stderr: 3d377e512a83 Extracting [==================================================>] 2.862kB/2.862kB Stderr: 3d377e512a83 Extracting [==================================================>] 2.862kB/2.862kB Stderr: 3d377e512a83 Extracting [==================================================>] 2.862kB/2.862kB Stderr: 3d377e512a83 Pull complete Stderr: 3d377e512a83 Pull complete Stderr: azurite1 Pulled Stderr: azurite1 Pulled Trying to create Minio instance by command docker compose --project-name roottestrestartwithunavailableazure-gw4 --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Trying to create Minio instance by command docker compose --project-name roottestrestartwithunavailableazure-gw4 --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Command:[docker compose --project-name roottestrestartwithunavailableazure-gw4 --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Command:[docker compose --project-name roottestrestartwithunavailableazure-gw4 --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Stderr:time="2025-04-02T02:58:41Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:58:41Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottestrestartwithunavailableazure-gw4_default Creating Stderr: Network roottestrestartwithunavailableazure-gw4_default Creating Stderr: Network roottestrestartwithunavailableazure-gw4_default Created Stderr: Network roottestrestartwithunavailableazure-gw4_default Created Stderr: Volume "roottestrestartwithunavailableazure-gw4_data1-1" Creating Stderr: Volume "roottestrestartwithunavailableazure-gw4_data1-1" Creating Stderr: Volume "roottestrestartwithunavailableazure-gw4_data1-1" Created Stderr: Volume "roottestrestartwithunavailableazure-gw4_data1-1" Created Stderr: Container roottestrestartwithunavailableazure-gw4-proxy2-1 Creating Stderr: Container roottestrestartwithunavailableazure-gw4-proxy2-1 Creating Stderr: Container roottestrestartwithunavailableazure-gw4-proxy1-1 Creating Stderr: Container roottestrestartwithunavailableazure-gw4-proxy1-1 Creating Stderr: Container roottestrestartwithunavailableazure-gw4-proxy2-1 Created Stderr: Container roottestrestartwithunavailableazure-gw4-proxy2-1 Created Stderr: Container roottestrestartwithunavailableazure-gw4-proxy1-1 Created Stderr: Container roottestrestartwithunavailableazure-gw4-proxy1-1 Created Stderr: Container roottestrestartwithunavailableazure-gw4-minio1-1 Creating Stderr: Container roottestrestartwithunavailableazure-gw4-minio1-1 Creating Stderr: Container roottestrestartwithunavailableazure-gw4-resolver-1 Creating Stderr: Container roottestrestartwithunavailableazure-gw4-resolver-1 Creating Stderr: Container roottestrestartwithunavailableazure-gw4-minio1-1 Created Stderr: Container roottestrestartwithunavailableazure-gw4-minio1-1 Created Stderr: Container roottestrestartwithunavailableazure-gw4-resolver-1 Created Stderr: Container roottestrestartwithunavailableazure-gw4-resolver-1 Created Stderr: Container roottestrestartwithunavailableazure-gw4-proxy2-1 Starting Stderr: Container roottestrestartwithunavailableazure-gw4-proxy2-1 Starting Stderr: Container roottestrestartwithunavailableazure-gw4-proxy1-1 Starting Stderr: Container roottestrestartwithunavailableazure-gw4-proxy1-1 Starting Stderr: Container roottestrestartwithunavailableazure-gw4-proxy1-1 Started Stderr: Container roottestrestartwithunavailableazure-gw4-proxy1-1 Started Stderr: Container roottestrestartwithunavailableazure-gw4-proxy2-1 Started Stderr: Container roottestrestartwithunavailableazure-gw4-proxy2-1 Started Stderr: Container roottestrestartwithunavailableazure-gw4-minio1-1 Starting Stderr: Container roottestrestartwithunavailableazure-gw4-minio1-1 Starting Stderr: Container roottestrestartwithunavailableazure-gw4-resolver-1 Starting Stderr: Container roottestrestartwithunavailableazure-gw4-resolver-1 Starting Stderr: Container roottestrestartwithunavailableazure-gw4-minio1-1 Started Stderr: Container roottestrestartwithunavailableazure-gw4-minio1-1 Started Stderr: Container roottestrestartwithunavailableazure-gw4-resolver-1 Started Stderr: Container roottestrestartwithunavailableazure-gw4-resolver-1 Started Stderr:time="2025-04-02T02:58:42Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:58:42Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:58:42Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:58:42Z" level=debug msg="otel error" error="" Trying to connect to Minio... Trying to connect to Minio... get_instance_ip instance_name=minio1 get_instance_ip instance_name=minio1 http://localhost:None "GET /v1.46/containers/roottestrestartwithunavailableazure-gw4-minio1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestartwithunavailableazure-gw4-minio1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy1 get_instance_ip instance_name=proxy1 http://localhost:None "GET /v1.46/containers/roottestrestartwithunavailableazure-gw4-proxy1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestartwithunavailableazure-gw4-proxy1-1/json HTTP/1.1" 200 None Starting new HTTP connection (1): 172.16.2.4:9001 Starting new HTTP connection (1): 172.16.2.4:9001 Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (2): 172.16.2.4:9001 Starting new HTTP connection (2): 172.16.2.4:9001 Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (3): 172.16.2.4:9001 Starting new HTTP connection (3): 172.16.2.4:9001 Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (4): 172.16.2.4:9001 Starting new HTTP connection (4): 172.16.2.4:9001 Can't connect to Minio: HTTPConnectionPool(host='172.16.2.4', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Can't connect to Minio: HTTPConnectionPool(host='172.16.2.4', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Starting new HTTP connection (5): 172.16.2.4:9001 Starting new HTTP connection (5): 172.16.2.4:9001 http://172.16.2.4:9001 "GET / HTTP/1.1" 200 0 http://172.16.2.4:9001 "GET / HTTP/1.1" 200 0 Connected to Minio. Connected to Minio. http://172.16.2.4:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.2.4:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.2.4:9001 "PUT /root HTTP/1.1" 200 0 http://172.16.2.4:9001 "PUT /root HTTP/1.1" 200 0 S3 bucket 'root' created S3 bucket 'root' created http://172.16.2.4:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.2.4:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.2.4:9001 "PUT /root2 HTTP/1.1" 200 0 http://172.16.2.4:9001 "PUT /root2 HTTP/1.1" 200 0 S3 bucket 'root2' created S3 bucket 'root2' created Trying to create Azurite instance by command docker compose --project-name roottestrestartwithunavailableazure-gw4 --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml --verbose up -d Trying to create Azurite instance by command docker compose --project-name roottestrestartwithunavailableazure-gw4 --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml --verbose up -d Command:[docker compose --project-name roottestrestartwithunavailableazure-gw4 --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml --verbose up -d] Command:[docker compose --project-name roottestrestartwithunavailableazure-gw4 --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml --verbose up -d] Stderr:time="2025-04-02T02:58:43Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:58:43Z" level=trace msg="Docker Desktop integration not enabled" Stderr:time="2025-04-02T02:58:43Z" level=warning msg="Found orphan containers ([roottestrestartwithunavailableazure-gw4-resolver-1 roottestrestartwithunavailableazure-gw4-minio1-1 roottestrestartwithunavailableazure-gw4-proxy1-1 roottestrestartwithunavailableazure-gw4-proxy2-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up." Stderr:time="2025-04-02T02:58:43Z" level=warning msg="Found orphan containers ([roottestrestartwithunavailableazure-gw4-resolver-1 roottestrestartwithunavailableazure-gw4-minio1-1 roottestrestartwithunavailableazure-gw4-proxy1-1 roottestrestartwithunavailableazure-gw4-proxy2-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up." Stderr: Container roottestrestartwithunavailableazure-gw4-azurite1-1 Creating Stderr: Container roottestrestartwithunavailableazure-gw4-azurite1-1 Creating Stderr: Container roottestrestartwithunavailableazure-gw4-azurite1-1 Created Stderr: Container roottestrestartwithunavailableazure-gw4-azurite1-1 Created Stderr: Container roottestrestartwithunavailableazure-gw4-azurite1-1 Starting Stderr: Container roottestrestartwithunavailableazure-gw4-azurite1-1 Starting Stderr: Container roottestrestartwithunavailableazure-gw4-azurite1-1 Started Stderr: Container roottestrestartwithunavailableazure-gw4-azurite1-1 Started Stderr:time="2025-04-02T02:58:43Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:58:43Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:58:43Z" level=debug msg="otel error" error="" Stderr:time="2025-04-02T02:58:43Z" level=debug msg="otel error" error="" Trying to connect to Azurite Trying to connect to Azurite Request URL: 'http://127.0.0.1:30200/devstoreaccount1/?restype=REDACTED&comp=REDACTED' Request method: 'GET' Request headers: 'x-ms-version': 'REDACTED' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6401bcfa-0f6e-11f0-b158-0242ac110002' 'Authorization': 'REDACTED' No body was attached to the request Request URL: 'http://127.0.0.1:30200/devstoreaccount1/?restype=REDACTED&comp=REDACTED' Request method: 'GET' Request headers: 'x-ms-version': 'REDACTED' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6401bcfa-0f6e-11f0-b158-0242ac110002' 'Authorization': 'REDACTED' No body was attached to the request Starting new HTTP connection (1): 127.0.0.1:30200 Starting new HTTP connection (1): 127.0.0.1:30200 http://127.0.0.1:30200 "GET /devstoreaccount1/?restype=account&comp=properties HTTP/1.1" 200 0 http://127.0.0.1:30200 "GET /devstoreaccount1/?restype=account&comp=properties HTTP/1.1" 200 0 Response status: 200 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'x-ms-client-request-id': '6401bcfa-0f6e-11f0-b158-0242ac110002' 'x-ms-request-id': '56f9d6a2-445c-4966-9398-a719b2f7ed39' 'x-ms-version': 'REDACTED' 'date': 'Wed, 02 Apr 2025 02:58:44 GMT' 'x-ms-sku-name': 'REDACTED' 'x-ms-account-kind': 'REDACTED' 'x-ms-is-hns-enabled': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' Response status: 200 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'x-ms-client-request-id': '6401bcfa-0f6e-11f0-b158-0242ac110002' 'x-ms-request-id': '56f9d6a2-445c-4966-9398-a719b2f7ed39' 'x-ms-version': 'REDACTED' 'date': 'Wed, 02 Apr 2025 02:58:44 GMT' 'x-ms-sku-name': 'REDACTED' 'x-ms-account-kind': 'REDACTED' 'x-ms-is-hns-enabled': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' {'client_request_id': '6401bcfa-0f6e-11f0-b158-0242ac110002', 'request_id': '56f9d6a2-445c-4966-9398-a719b2f7ed39', 'version': '2025-05-05', 'date': datetime.datetime(2025, 4, 2, 2, 58, 44, tzinfo=datetime.timezone.utc), 'sku_name': 'Standard_RAGRS', 'account_kind': 'StorageV2', 'is_hns_enabled': False} {'client_request_id': '6401bcfa-0f6e-11f0-b158-0242ac110002', 'request_id': '56f9d6a2-445c-4966-9398-a719b2f7ed39', 'version': '2025-05-05', 'date': datetime.datetime(2025, 4, 2, 2, 58, 44, tzinfo=datetime.timezone.utc), 'sku_name': 'Standard_RAGRS', 'account_kind': 'StorageV2', 'is_hns_enabled': False} Request URL: 'http://127.0.0.1:30200/devstoreaccount1/?comp=REDACTED&prefix=REDACTED&include=REDACTED' Request method: 'GET' Request headers: 'x-ms-version': 'REDACTED' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '64085bc8-0f6e-11f0-b158-0242ac110002' 'Authorization': 'REDACTED' No body was attached to the request Request URL: 'http://127.0.0.1:30200/devstoreaccount1/?comp=REDACTED&prefix=REDACTED&include=REDACTED' Request method: 'GET' Request headers: 'x-ms-version': 'REDACTED' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '64085bc8-0f6e-11f0-b158-0242ac110002' 'Authorization': 'REDACTED' No body was attached to the request http://127.0.0.1:30200 "GET /devstoreaccount1/?comp=list&prefix=azurite-container&include= HTTP/1.1" 200 None http://127.0.0.1:30200 "GET /devstoreaccount1/?comp=list&prefix=azurite-container&include= HTTP/1.1" 200 None Response status: 200 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'x-ms-client-request-id': '64085bc8-0f6e-11f0-b158-0242ac110002' 'x-ms-request-id': '44faf708-9e21-4733-82d7-9f7eb769caea' 'x-ms-version': 'REDACTED' 'content-type': 'application/xml' 'Date': 'Wed, 02 Apr 2025 02:58:44 GMT' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Transfer-Encoding': 'chunked' Response status: 200 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'x-ms-client-request-id': '64085bc8-0f6e-11f0-b158-0242ac110002' 'x-ms-request-id': '44faf708-9e21-4733-82d7-9f7eb769caea' 'x-ms-version': 'REDACTED' 'content-type': 'application/xml' 'Date': 'Wed, 02 Apr 2025 02:58:44 GMT' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Transfer-Encoding': 'chunked' Request URL: 'http://127.0.0.1:30200/devstoreaccount1/azurite-container?restype=REDACTED' Request method: 'GET' Request headers: 'x-ms-version': 'REDACTED' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '640b82b2-0f6e-11f0-b158-0242ac110002' 'Authorization': 'REDACTED' No body was attached to the request Request URL: 'http://127.0.0.1:30200/devstoreaccount1/azurite-container?restype=REDACTED' Request method: 'GET' Request headers: 'x-ms-version': 'REDACTED' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '640b82b2-0f6e-11f0-b158-0242ac110002' 'Authorization': 'REDACTED' No body was attached to the request http://127.0.0.1:30200 "GET /devstoreaccount1/azurite-container?restype=container HTTP/1.1" 404 None http://127.0.0.1:30200 "GET /devstoreaccount1/azurite-container?restype=container HTTP/1.1" 404 None Response status: 404 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'x-ms-error-code': 'ContainerNotFound' 'x-ms-request-id': '8a279dde-51ef-48f1-8622-c84779d668e2' 'content-type': 'application/xml' 'Date': 'Wed, 02 Apr 2025 02:58:44 GMT' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Transfer-Encoding': 'chunked' Response status: 404 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'x-ms-error-code': 'ContainerNotFound' 'x-ms-request-id': '8a279dde-51ef-48f1-8622-c84779d668e2' 'content-type': 'application/xml' 'Date': 'Wed, 02 Apr 2025 02:58:44 GMT' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Transfer-Encoding': 'chunked' azurite container 'azurite-container' doesn't exist, creating it azurite container 'azurite-container' doesn't exist, creating it Request URL: 'http://127.0.0.1:30200/devstoreaccount1/azurite-container?restype=REDACTED' Request method: 'PUT' Request headers: 'x-ms-version': 'REDACTED' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '640d10c8-0f6e-11f0-b158-0242ac110002' 'Authorization': 'REDACTED' No body was attached to the request Request URL: 'http://127.0.0.1:30200/devstoreaccount1/azurite-container?restype=REDACTED' Request method: 'PUT' Request headers: 'x-ms-version': 'REDACTED' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '640d10c8-0f6e-11f0-b158-0242ac110002' 'Authorization': 'REDACTED' No body was attached to the request http://127.0.0.1:30200 "PUT /devstoreaccount1/azurite-container?restype=container HTTP/1.1" 201 0 http://127.0.0.1:30200 "PUT /devstoreaccount1/azurite-container?restype=container HTTP/1.1" 201 0 Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x20160B485A7C680"' 'last-modified': 'Wed, 02 Apr 2025 02:58:44 GMT' 'x-ms-client-request-id': '640d10c8-0f6e-11f0-b158-0242ac110002' 'x-ms-request-id': '7a3f3ea5-b37b-4980-bec2-e9c94adb4f3c' 'x-ms-version': 'REDACTED' 'Date': 'Wed, 02 Apr 2025 02:58:44 GMT' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x20160B485A7C680"' 'last-modified': 'Wed, 02 Apr 2025 02:58:44 GMT' 'x-ms-client-request-id': '640d10c8-0f6e-11f0-b158-0242ac110002' 'x-ms-request-id': '7a3f3ea5-b37b-4980-bec2-e9c94adb4f3c' 'x-ms-version': 'REDACTED' 'Date': 'Wed, 02 Apr 2025 02:58:44 GMT' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/.env --project-name roottestrestartwithunavailableazure-gw4 --file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml up -d --no-recreate') ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/.env --project-name roottestrestartwithunavailableazure-gw4 --file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/.env --project-name roottestrestartwithunavailableazure-gw4 --file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml up -d --no-recreate] Command:[docker compose --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/.env --project-name roottestrestartwithunavailableazure-gw4 --file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml up -d --no-recreate] Stderr: Container roottestrestartwithunavailableazure-gw4-azurite1-1 Running Stderr: Container roottestrestartwithunavailableazure-gw4-azurite1-1 Running Stderr: Container roottestrestartwithunavailableazure-gw4-proxy1-1 Running Stderr: Container roottestrestartwithunavailableazure-gw4-proxy1-1 Running Stderr: Container roottestrestartwithunavailableazure-gw4-proxy2-1 Running Stderr: Container roottestrestartwithunavailableazure-gw4-proxy2-1 Running Stderr: Container roottestrestartwithunavailableazure-gw4-minio1-1 Running Stderr: Container roottestrestartwithunavailableazure-gw4-minio1-1 Running Stderr: Container roottestrestartwithunavailableazure-gw4-resolver-1 Running Stderr: Container roottestrestartwithunavailableazure-gw4-resolver-1 Running Stderr: Container roottestrestartwithunavailableazure-gw4-node-1 Creating Stderr: Container roottestrestartwithunavailableazure-gw4-node-1 Creating Stderr: Container roottestrestartwithunavailableazure-gw4-node-1 Created Stderr: Container roottestrestartwithunavailableazure-gw4-node-1 Created Stderr: Container roottestrestartwithunavailableazure-gw4-node-1 Starting Stderr: Container roottestrestartwithunavailableazure-gw4-node-1 Starting Stderr: Container roottestrestartwithunavailableazure-gw4-node-1 Started Stderr: Container roottestrestartwithunavailableazure-gw4-node-1 Started ClickHouse instance created ClickHouse instance created get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottestrestartwithunavailableazure-gw4-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestartwithunavailableazure-gw4-node-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node get_instance_ip instance_name=node http://localhost:None "GET /v1.46/containers/roottestrestartwithunavailableazure-gw4-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestartwithunavailableazure-gw4-node-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node, ip: 172.16.2.7... Waiting for ClickHouse start in node, ip: 172.16.2.7... http://localhost:None "GET /v1.46/containers/roottestrestartwithunavailableazure-gw4-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/roottestrestartwithunavailableazure-gw4-node-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/d6139eee10d4559081294028b9dba4614a0e70c9627793a96f77105d1d63bf0d/json HTTP/1.1" 200 None ClickHouse node started ClickHouse node started Starting custom Azure endpoint Starting custom Azure endpoint Starting mock server endpoint.py Starting mock server endpoint.py run container_id:roottestrestartwithunavailableazure-gw4-resolver-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname endpoint.py) && echo IyEvdXNyL2Jpbi9lbnYgcHl0aG9uMwpmcm9tIGJvdHRsZSBpbXBvcnQgcmVxdWVzdCwgcmVzcG9uc2UsIHJvdXRlLCBydW4KCgpAcm91dGUoIi88X2J1Y2tldD4vPF9wYXRoOnBhdGg+IiwgWyJHRVQiLCAiUE9TVCIsICJQVVQiLCAiREVMRVRFIl0pCmRlZiBzZXJ2ZXIoX2J1Y2tldCwgX3BhdGgpOgogICAgcmVzcG9uc2Uuc3RhdHVzID0gNDAzCiAgICByZXR1cm4gIkZvcmJpZGRlbiIKCgpAcm91dGUoIi8iKQpkZWYgcGluZygpOgogICAgcmV0dXJuICJPSyIKCgpydW4oaG9zdD0iMC4wLjAuMCIsIHBvcnQ9ODA4MCkK | base64 --decode > endpoint.py'] run container_id:roottestrestartwithunavailableazure-gw4-resolver-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname endpoint.py) && echo IyEvdXNyL2Jpbi9lbnYgcHl0aG9uMwpmcm9tIGJvdHRsZSBpbXBvcnQgcmVxdWVzdCwgcmVzcG9uc2UsIHJvdXRlLCBydW4KCgpAcm91dGUoIi88X2J1Y2tldD4vPF9wYXRoOnBhdGg+IiwgWyJHRVQiLCAiUE9TVCIsICJQVVQiLCAiREVMRVRFIl0pCmRlZiBzZXJ2ZXIoX2J1Y2tldCwgX3BhdGgpOgogICAgcmVzcG9uc2Uuc3RhdHVzID0gNDAzCiAgICByZXR1cm4gIkZvcmJpZGRlbiIKCgpAcm91dGUoIi8iKQpkZWYgcGluZygpOgogICAgcmV0dXJuICJPSyIKCgpydW4oaG9zdD0iMC4wLjAuMCIsIHBvcnQ9ODA4MCkK | base64 --decode > endpoint.py'] Command:[docker exec roottestrestartwithunavailableazure-gw4-resolver-1 bash -c mkdir -p $(dirname endpoint.py) && echo IyEvdXNyL2Jpbi9lbnYgcHl0aG9uMwpmcm9tIGJvdHRsZSBpbXBvcnQgcmVxdWVzdCwgcmVzcG9uc2UsIHJvdXRlLCBydW4KCgpAcm91dGUoIi88X2J1Y2tldD4vPF9wYXRoOnBhdGg+IiwgWyJHRVQiLCAiUE9TVCIsICJQVVQiLCAiREVMRVRFIl0pCmRlZiBzZXJ2ZXIoX2J1Y2tldCwgX3BhdGgpOgogICAgcmVzcG9uc2Uuc3RhdHVzID0gNDAzCiAgICByZXR1cm4gIkZvcmJpZGRlbiIKCgpAcm91dGUoIi8iKQpkZWYgcGluZygpOgogICAgcmV0dXJuICJPSyIKCgpydW4oaG9zdD0iMC4wLjAuMCIsIHBvcnQ9ODA4MCkK | base64 --decode > endpoint.py] Command:[docker exec roottestrestartwithunavailableazure-gw4-resolver-1 bash -c mkdir -p $(dirname endpoint.py) && echo IyEvdXNyL2Jpbi9lbnYgcHl0aG9uMwpmcm9tIGJvdHRsZSBpbXBvcnQgcmVxdWVzdCwgcmVzcG9uc2UsIHJvdXRlLCBydW4KCgpAcm91dGUoIi88X2J1Y2tldD4vPF9wYXRoOnBhdGg+IiwgWyJHRVQiLCAiUE9TVCIsICJQVVQiLCAiREVMRVRFIl0pCmRlZiBzZXJ2ZXIoX2J1Y2tldCwgX3BhdGgpOgogICAgcmVzcG9uc2Uuc3RhdHVzID0gNDAzCiAgICByZXR1cm4gIkZvcmJpZGRlbiIKCgpAcm91dGUoIi8iKQpkZWYgcGluZygpOgogICAgcmV0dXJuICJPSyIKCgpydW4oaG9zdD0iMC4wLjAuMCIsIHBvcnQ9ODA4MCkK | base64 --decode > endpoint.py] run container_id:roottestrestartwithunavailableazure-gw4-resolver-1 detach:True nothrow:False cmd: ['bash', '-c', 'python3 endpoint.py 8080 >/var/log/resolver/endpoint.log 2>/var/log/resolver/endpoint.err.log'] run container_id:roottestrestartwithunavailableazure-gw4-resolver-1 detach:True nothrow:False cmd: ['bash', '-c', 'python3 endpoint.py 8080 >/var/log/resolver/endpoint.log 2>/var/log/resolver/endpoint.err.log'] Command:[docker exec roottestrestartwithunavailableazure-gw4-resolver-1 bash -c python3 endpoint.py 8080 >/var/log/resolver/endpoint.log 2>/var/log/resolver/endpoint.err.log] Command:[docker exec roottestrestartwithunavailableazure-gw4-resolver-1 bash -c python3 endpoint.py 8080 >/var/log/resolver/endpoint.log 2>/var/log/resolver/endpoint.err.log] run container_id:roottestrestartwithunavailableazure-gw4-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] run container_id:roottestrestartwithunavailableazure-gw4-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] Command:[docker exec roottestrestartwithunavailableazure-gw4-resolver-1 curl -s http://localhost:8080/] Command:[docker exec roottestrestartwithunavailableazure-gw4-resolver-1 curl -s http://localhost:8080/] Exitcode:7 Exitcode:7 run container_id:roottestrestartwithunavailableazure-gw4-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] run container_id:roottestrestartwithunavailableazure-gw4-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8080/'] Command:[docker exec roottestrestartwithunavailableazure-gw4-resolver-1 curl -s http://localhost:8080/] Command:[docker exec roottestrestartwithunavailableazure-gw4-resolver-1 curl -s http://localhost:8080/] Stdout:OK Stdout:OK endpoint.py answered OK on attempt 2 endpoint.py answered OK on attempt 2 Mock server endpoint.py started Mock server endpoint.py started Azure endpoint started Azure endpoint started Executing query CREATE TABLE test_table (a UInt64, b String) ENGINE = AzureBlobStorage('DefaultEndpointsProtocol=http;AccountName=devstoreaccount1;AccountKey=Eby8vdM02xNOcqFlqUwJPLlmEtlCDXJ1OUzFT50uSRZ6IFsuFq2UVErCz4I6tq/K1SZFPTOtr/KBHBeksoGMGw==;BlobEndpoint=http://azurite1:30200/devstoreaccount1;', 'cont', 'test_table.csv', 'CSV') ORDER BY tuple() on node Executing query CREATE TABLE test_table (a UInt64, b String) ENGINE = AzureBlobStorage('DefaultEndpointsProtocol=http;AccountName=devstoreaccount1;AccountKey=Eby8vdM02xNOcqFlqUwJPLlmEtlCDXJ1OUzFT50uSRZ6IFsuFq2UVErCz4I6tq/K1SZFPTOtr/KBHBeksoGMGw==;BlobEndpoint=http://azurite1:30200/devstoreaccount1;', 'cont', 'test_table.csv', 'CSV') ORDER BY tuple() on node run container_id:roottestrestartwithunavailableazure-gw4-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] run container_id:roottestrestartwithunavailableazure-gw4-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] Command:[docker exec -u root roottestrestartwithunavailableazure-gw4-node-1 bash -c ps -C clickhouse] Command:[docker exec -u root roottestrestartwithunavailableazure-gw4-node-1 bash -c ps -C clickhouse] Stdout: PID TTY TIME CMD Stdout: PID TTY TIME CMD Stdout: 8 ? 00:00:02 clickhouse Stdout: 8 ? 00:00:02 clickhouse run container_id:roottestrestartwithunavailableazure-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] run container_id:roottestrestartwithunavailableazure-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] Command:[docker exec -u root roottestrestartwithunavailableazure-gw4-node-1 bash -c pkill clickhouse] Command:[docker exec -u root roottestrestartwithunavailableazure-gw4-node-1 bash -c pkill clickhouse] run container_id:roottestrestartwithunavailableazure-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrestartwithunavailableazure-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrestartwithunavailableazure-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrestartwithunavailableazure-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8 Stdout:8 run container_id:roottestrestartwithunavailableazure-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrestartwithunavailableazure-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrestartwithunavailableazure-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrestartwithunavailableazure-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8 Stdout:8 run container_id:roottestrestartwithunavailableazure-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrestartwithunavailableazure-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrestartwithunavailableazure-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrestartwithunavailableazure-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8 Stdout:8 run container_id:roottestrestartwithunavailableazure-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrestartwithunavailableazure-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrestartwithunavailableazure-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrestartwithunavailableazure-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8 Stdout:8 Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node run container_id:roottestrestartwithunavailableazure-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrestartwithunavailableazure-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrestartwithunavailableazure-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrestartwithunavailableazure-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:8 Stdout:8 run container_id:roottestrestartwithunavailableazure-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrestartwithunavailableazure-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrestartwithunavailableazure-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrestartwithunavailableazure-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] run container_id:roottestrestartwithunavailableazure-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's|azurite1:30200|resolver:8080|g' /var/lib/clickhouse/metadata/default/test_table.sql"] run container_id:roottestrestartwithunavailableazure-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "sed -i 's|azurite1:30200|resolver:8080|g' /var/lib/clickhouse/metadata/default/test_table.sql"] Command:[docker exec roottestrestartwithunavailableazure-gw4-node-1 bash -c sed -i 's|azurite1:30200|resolver:8080|g' /var/lib/clickhouse/metadata/default/test_table.sql] Command:[docker exec roottestrestartwithunavailableazure-gw4-node-1 bash -c sed -i 's|azurite1:30200|resolver:8080|g' /var/lib/clickhouse/metadata/default/test_table.sql] run container_id:roottestrestartwithunavailableazure-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrestartwithunavailableazure-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrestartwithunavailableazure-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrestartwithunavailableazure-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] No clickhouse process running. Start new one. No clickhouse process running. Start new one. http://localhost:None "POST /v1.46/containers/roottestrestartwithunavailableazure-gw4-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/containers/roottestrestartwithunavailableazure-gw4-node-1/exec HTTP/1.1" 201 74 http://localhost:None "POST /v1.46/exec/c12b63c0ee432dc5802a5855eb70535387b0a3e0ec6bf998af3e1d5fac715c78/start HTTP/1.1" 200 0 http://localhost:None "POST /v1.46/exec/c12b63c0ee432dc5802a5855eb70535387b0a3e0ec6bf998af3e1d5fac715c78/start HTTP/1.1" 200 0 http://localhost:None "GET /v1.46/exec/c12b63c0ee432dc5802a5855eb70535387b0a3e0ec6bf998af3e1d5fac715c78/json HTTP/1.1" 200 587 http://localhost:None "GET /v1.46/exec/c12b63c0ee432dc5802a5855eb70535387b0a3e0ec6bf998af3e1d5fac715c78/json HTTP/1.1" 200 587 run container_id:roottestrestartwithunavailableazure-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrestartwithunavailableazure-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrestartwithunavailableazure-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrestartwithunavailableazure-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:782 Stdout:782 Clickhouse process running. Clickhouse process running. run container_id:roottestrestartwithunavailableazure-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] run container_id:roottestrestartwithunavailableazure-gw4-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] Command:[docker exec roottestrestartwithunavailableazure-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Command:[docker exec roottestrestartwithunavailableazure-gw4-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] Stdout:782 Stdout:782 Executing query select 20 on node Executing query select 20 on node Executing query select 20 on node Executing query select 20 on node Executing query select 20 on node Executing query select 20 on node Executing query DROP TABLE test_table on node Executing query DROP TABLE test_table on node Command:[docker compose --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/.env --project-name roottestrestartwithunavailableazure-gw4 --file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/.env --project-name roottestrestartwithunavailableazure-gw4 --file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml stop --timeout 20] [gw4] PASSED test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node Executing query SYSTEM RELOAD CONFIG on node Executing query SYSTEM RELOAD CONFIG on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node [gw8] PASSED test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Stderr: Container roottestrestartwithunavailableazure-gw4-resolver-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw4-resolver-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw4-node-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw4-node-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw4-node-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw4-node-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw4-minio1-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw4-minio1-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw4-azurite1-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw4-azurite1-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw4-minio1-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw4-minio1-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw4-azurite1-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw4-azurite1-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw4-resolver-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw4-resolver-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw4-proxy1-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw4-proxy1-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw4-proxy2-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw4-proxy2-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw4-proxy2-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw4-proxy2-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw4-proxy1-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw4-proxy1-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/.env --project-name roottestrestartwithunavailableazure-gw4 --file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/.env --project-name roottestrestartwithunavailableazure-gw4 --file /ClickHouse/tests/integration/test_restart_with_unavailable_azure/_instances-0-gw4/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml down --volumes] Stderr: Container roottestrestartwithunavailableazure-gw4-node-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw4-node-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw4-resolver-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw4-resolver-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw4-node-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw4-node-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw4-node-1 Removing Stderr: Container roottestrestartwithunavailableazure-gw4-node-1 Removing Stderr: Container roottestrestartwithunavailableazure-gw4-resolver-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw4-resolver-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw4-resolver-1 Removing Stderr: Container roottestrestartwithunavailableazure-gw4-resolver-1 Removing Stderr: Container roottestrestartwithunavailableazure-gw4-node-1 Removed Stderr: Container roottestrestartwithunavailableazure-gw4-node-1 Removed Stderr: Container roottestrestartwithunavailableazure-gw4-azurite1-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw4-azurite1-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw4-minio1-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw4-minio1-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw4-minio1-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw4-minio1-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw4-minio1-1 Removing Stderr: Container roottestrestartwithunavailableazure-gw4-minio1-1 Removing Stderr: Container roottestrestartwithunavailableazure-gw4-azurite1-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw4-azurite1-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw4-azurite1-1 Removing Stderr: Container roottestrestartwithunavailableazure-gw4-azurite1-1 Removing Stderr: Container roottestrestartwithunavailableazure-gw4-resolver-1 Removed Stderr: Container roottestrestartwithunavailableazure-gw4-resolver-1 Removed Stderr: Container roottestrestartwithunavailableazure-gw4-minio1-1 Removed Stderr: Container roottestrestartwithunavailableazure-gw4-minio1-1 Removed Stderr: Container roottestrestartwithunavailableazure-gw4-proxy2-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw4-proxy2-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw4-proxy1-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw4-proxy1-1 Stopping Stderr: Container roottestrestartwithunavailableazure-gw4-proxy1-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw4-proxy1-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw4-proxy1-1 Removing Stderr: Container roottestrestartwithunavailableazure-gw4-proxy1-1 Removing Stderr: Container roottestrestartwithunavailableazure-gw4-proxy2-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw4-proxy2-1 Stopped Stderr: Container roottestrestartwithunavailableazure-gw4-proxy2-1 Removing Stderr: Container roottestrestartwithunavailableazure-gw4-proxy2-1 Removing Stderr: Container roottestrestartwithunavailableazure-gw4-azurite1-1 Removed Stderr: Container roottestrestartwithunavailableazure-gw4-azurite1-1 Removed Stderr: Container roottestrestartwithunavailableazure-gw4-proxy1-1 Removed Stderr: Container roottestrestartwithunavailableazure-gw4-proxy1-1 Removed Stderr: Container roottestrestartwithunavailableazure-gw4-proxy2-1 Removed Stderr: Container roottestrestartwithunavailableazure-gw4-proxy2-1 Removed Stderr: Volume roottestrestartwithunavailableazure-gw4_data1-1 Removing Stderr: Volume roottestrestartwithunavailableazure-gw4_data1-1 Removing Stderr: Network roottestrestartwithunavailableazure-gw4_default Removing Stderr: Network roottestrestartwithunavailableazure-gw4_default Removing Stderr: Volume roottestrestartwithunavailableazure-gw4_data1-1 Removed Stderr: Volume roottestrestartwithunavailableazure-gw4_data1-1 Removed Stderr: Network roottestrestartwithunavailableazure-gw4_default Removed Stderr: Network roottestrestartwithunavailableazure-gw4_default Removed Cleanup called Cleanup called Docker networks for project roottestrestartwithunavailableazure-gw4 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestrestartwithunavailableazure-gw4 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestrestartwithunavailableazure-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestrestartwithunavailableazure-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestrestartwithunavailableazure-gw4 are DRIVER VOLUME NAME Docker volumes for project roottestrestartwithunavailableazure-gw4 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestrestartwithunavailableazure-gw4-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestrestartwithunavailableazure-gw4-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestrestartwithunavailableazure-gw4 No running containers for project: roottestrestartwithunavailableazure-gw4 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:1 Stdout:1 Volumes pruned: 1 Volumes pruned: 1 Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Connection dropped: socket connection error: None Connection dropped: socket connection error: None Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/.env --project-name roottestreloadclustersconfig-gw8 --file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop --timeout 20] Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/.env --project-name roottestreloadclustersconfig-gw8 --file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop --timeout 20] [gw8] FAILED test_reload_clusters_config/test.py::test_update_one_cluster Connection dropped: socket connection error: None Connection dropped: socket connection error: None Failed connecting to Zookeeper within the connection retry policy. Failed connecting to Zookeeper within the connection retry policy. Stderr: Container roottestreloadclustersconfig-gw8-node-1 Stopping Stderr: Container roottestreloadclustersconfig-gw8-node-1 Stopping Stderr: Container roottestreloadclustersconfig-gw8-node-1 Stopped Stderr: Container roottestreloadclustersconfig-gw8-node-1 Stopped Stderr: Container roottestreloadclustersconfig-gw8-zoo1-1 Stopping Stderr: Container roottestreloadclustersconfig-gw8-zoo1-1 Stopping Stderr: Container roottestreloadclustersconfig-gw8-zoo2-1 Stopping Stderr: Container roottestreloadclustersconfig-gw8-zoo2-1 Stopping Stderr: Container roottestreloadclustersconfig-gw8-zoo3-1 Stopping Stderr: Container roottestreloadclustersconfig-gw8-zoo3-1 Stopping Stderr: Container roottestreloadclustersconfig-gw8-zoo3-1 Stopped Stderr: Container roottestreloadclustersconfig-gw8-zoo3-1 Stopped Stderr: Container roottestreloadclustersconfig-gw8-zoo2-1 Stopped Stderr: Container roottestreloadclustersconfig-gw8-zoo2-1 Stopped Stderr: Container roottestreloadclustersconfig-gw8-zoo1-1 Stopped Stderr: Container roottestreloadclustersconfig-gw8-zoo1-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[bash -c [ -f /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/.env --project-name roottestreloadclustersconfig-gw8 --file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml down --volumes] Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/.env --project-name roottestreloadclustersconfig-gw8 --file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml down --volumes] Stderr: Container roottestreloadclustersconfig-gw8-node-1 Stopping Stderr: Container roottestreloadclustersconfig-gw8-node-1 Stopping Stderr: Container roottestreloadclustersconfig-gw8-node-1 Stopped Stderr: Container roottestreloadclustersconfig-gw8-node-1 Stopped Stderr: Container roottestreloadclustersconfig-gw8-node-1 Removing Stderr: Container roottestreloadclustersconfig-gw8-node-1 Removing Stderr: Container roottestreloadclustersconfig-gw8-node-1 Removed Stderr: Container roottestreloadclustersconfig-gw8-node-1 Removed Stderr: Container roottestreloadclustersconfig-gw8-zoo2-1 Stopping Stderr: Container roottestreloadclustersconfig-gw8-zoo2-1 Stopping Stderr: Container roottestreloadclustersconfig-gw8-zoo3-1 Stopping Stderr: Container roottestreloadclustersconfig-gw8-zoo3-1 Stopping Stderr: Container roottestreloadclustersconfig-gw8-zoo1-1 Stopping Stderr: Container roottestreloadclustersconfig-gw8-zoo1-1 Stopping Stderr: Container roottestreloadclustersconfig-gw8-zoo2-1 Stopped Stderr: Container roottestreloadclustersconfig-gw8-zoo2-1 Stopped Stderr: Container roottestreloadclustersconfig-gw8-zoo2-1 Removing Stderr: Container roottestreloadclustersconfig-gw8-zoo2-1 Removing Stderr: Container roottestreloadclustersconfig-gw8-zoo3-1 Stopped Stderr: Container roottestreloadclustersconfig-gw8-zoo3-1 Stopped Stderr: Container roottestreloadclustersconfig-gw8-zoo3-1 Removing Stderr: Container roottestreloadclustersconfig-gw8-zoo3-1 Removing Stderr: Container roottestreloadclustersconfig-gw8-zoo1-1 Stopped Stderr: Container roottestreloadclustersconfig-gw8-zoo1-1 Stopped Stderr: Container roottestreloadclustersconfig-gw8-zoo1-1 Removing Stderr: Container roottestreloadclustersconfig-gw8-zoo1-1 Removing Stderr: Container roottestreloadclustersconfig-gw8-zoo2-1 Removed Stderr: Container roottestreloadclustersconfig-gw8-zoo2-1 Removed Stderr: Container roottestreloadclustersconfig-gw8-zoo3-1 Removed Stderr: Container roottestreloadclustersconfig-gw8-zoo3-1 Removed Stderr: Container roottestreloadclustersconfig-gw8-zoo1-1 Removed Stderr: Container roottestreloadclustersconfig-gw8-zoo1-1 Removed Stderr: Network roottestreloadclustersconfig-gw8_default Removing Stderr: Network roottestreloadclustersconfig-gw8_default Removing Stderr: Network roottestreloadclustersconfig-gw8_default Removed Stderr: Network roottestreloadclustersconfig-gw8_default Removed Cleanup called Cleanup called Docker networks for project roottestreloadclustersconfig-gw8 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreloadclustersconfig-gw8 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreloadclustersconfig-gw8 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreloadclustersconfig-gw8 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreloadclustersconfig-gw8 are DRIVER VOLUME NAME Docker volumes for project roottestreloadclustersconfig-gw8 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestreloadclustersconfig-gw8-.*-1$' --format '{{.ID}}:{{.Names}}'] Command:[docker container list --all --filter name='^/roottestreloadclustersconfig-gw8-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreloadclustersconfig-gw8 No running containers for project: roottestreloadclustersconfig-gw8 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused images... Trying to prune unused images... Command:[docker image prune -f] Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Stdout:Total reclaimed space: 0B Images pruned Images pruned Trying to prune unused volumes... Trying to prune unused volumes... Command:[docker volume ls | wc -l] Command:[docker volume ls | wc -l] Stdout:1 Stdout:1 Volumes pruned: 1 Volumes pruned: 1 =================================== FAILURES =================================== ___________________________ test_update_one_cluster ____________________________ [gw8] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = def test_update_one_cluster(started_cluster): send_repeated_query("distributed") send_repeated_query("distributed2") > assert get_errors_count("test_cluster") > 0 E AssertionError: assert 0 > 0 E + where 0 = get_errors_count('test_cluster') test_reload_clusters_config/test.py:202: AssertionError ------------------------------ Captured log call ------------------------------- 2025-04-02 02:59:17 [ 784 ] DEBUG : Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3647, query_and_get_error) 2025-04-02 02:59:29 [ 784 ] DEBUG : Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3647, query_and_get_error) 2025-04-02 02:59:42 [ 784 ] DEBUG : Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3647, query_and_get_error) 2025-04-02 02:59:54 [ 784 ] DEBUG : Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3647, query_and_get_error) 2025-04-02 03:00:07 [ 784 ] DEBUG : Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3647, query_and_get_error) 2025-04-02 03:00:21 [ 784 ] DEBUG : Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3647, query_and_get_error) 2025-04-02 03:00:33 [ 784 ] DEBUG : Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3647, query_and_get_error) 2025-04-02 03:00:45 [ 784 ] DEBUG : Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3647, query_and_get_error) 2025-04-02 03:00:58 [ 784 ] DEBUG : Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3647, query_and_get_error) 2025-04-02 03:01:11 [ 784 ] DEBUG : Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3647, query_and_get_error) 2025-04-02 03:01:23 [ 784 ] DEBUG : Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node (cluster.py:3564, query) ---------------------------- Captured log teardown ----------------------------- 2025-04-02 03:01:24 [ 784 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/.env --project-name roottestreloadclustersconfig-gw8 --file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop --timeout 20] (cluster.py:120, run_and_check) 2025-04-02 03:01:35 [ 784 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw8-node-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:01:35 [ 784 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw8-node-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:01:35 [ 784 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw8-zoo1-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:01:35 [ 784 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw8-zoo2-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:01:35 [ 784 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw8-zoo3-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:01:35 [ 784 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw8-zoo3-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:01:35 [ 784 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw8-zoo2-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:01:35 [ 784 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw8-zoo1-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:01:35 [ 784 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:120, run_and_check) 2025-04-02 03:01:35 [ 784 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/.env --project-name roottestreloadclustersconfig-gw8 --file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw8/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml down --volumes] (cluster.py:120, run_and_check) 2025-04-02 03:01:35 [ 784 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw8-node-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:01:35 [ 784 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw8-node-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:01:35 [ 784 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw8-node-1 Removing (cluster.py:146, run_and_check) 2025-04-02 03:01:35 [ 784 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw8-node-1 Removed (cluster.py:146, run_and_check) 2025-04-02 03:01:35 [ 784 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw8-zoo2-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:01:35 [ 784 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw8-zoo3-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:01:35 [ 784 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw8-zoo1-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:01:35 [ 784 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw8-zoo2-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:01:35 [ 784 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw8-zoo2-1 Removing (cluster.py:146, run_and_check) 2025-04-02 03:01:35 [ 784 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw8-zoo3-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:01:35 [ 784 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw8-zoo3-1 Removing (cluster.py:146, run_and_check) 2025-04-02 03:01:35 [ 784 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw8-zoo1-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:01:35 [ 784 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw8-zoo1-1 Removing (cluster.py:146, run_and_check) 2025-04-02 03:01:35 [ 784 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw8-zoo2-1 Removed (cluster.py:146, run_and_check) 2025-04-02 03:01:35 [ 784 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw8-zoo3-1 Removed (cluster.py:146, run_and_check) 2025-04-02 03:01:35 [ 784 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw8-zoo1-1 Removed (cluster.py:146, run_and_check) 2025-04-02 03:01:35 [ 784 ] DEBUG : Stderr: Network roottestreloadclustersconfig-gw8_default Removing (cluster.py:146, run_and_check) 2025-04-02 03:01:35 [ 784 ] DEBUG : Stderr: Network roottestreloadclustersconfig-gw8_default Removed (cluster.py:146, run_and_check) 2025-04-02 03:01:35 [ 784 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2025-04-02 03:01:35 [ 784 ] DEBUG : Docker networks for project roottestreloadclustersconfig-gw8 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2025-04-02 03:01:35 [ 784 ] DEBUG : Docker containers for project roottestreloadclustersconfig-gw8 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2025-04-02 03:01:35 [ 784 ] DEBUG : Docker volumes for project roottestreloadclustersconfig-gw8 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2025-04-02 03:01:35 [ 784 ] DEBUG : Command:[docker container list --all --filter name='^/roottestreloadclustersconfig-gw8-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:120, run_and_check) 2025-04-02 03:01:35 [ 784 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2025-04-02 03:01:35 [ 784 ] DEBUG : No running containers for project: roottestreloadclustersconfig-gw8 (cluster.py:904, cleanup) 2025-04-02 03:01:35 [ 784 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2025-04-02 03:01:35 [ 784 ] DEBUG : Trying to prune unused images... (cluster.py:926, cleanup) 2025-04-02 03:01:35 [ 784 ] DEBUG : Command:[docker image prune -f] (cluster.py:120, run_and_check) 2025-04-02 03:01:36 [ 784 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:144, run_and_check) 2025-04-02 03:01:36 [ 784 ] DEBUG : Images pruned (cluster.py:929, cleanup) 2025-04-02 03:01:36 [ 784 ] DEBUG : Trying to prune unused volumes... (cluster.py:935, cleanup) 2025-04-02 03:01:36 [ 784 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:120, run_and_check) 2025-04-02 03:01:36 [ 784 ] DEBUG : Stdout:1 (cluster.py:144, run_and_check) 2025-04-02 03:01:36 [ 784 ] DEBUG : Volumes pruned: 1 (cluster.py:940, cleanup) =============================== warnings summary =============================== test_reload_client_certificate/test.py: 35 warnings /usr/local/lib/python3.10/dist-packages/kazoo/handlers/utils.py:225: DeprecationWarning: ssl.PROTOCOL_TLS is deprecated context = ssl.SSLContext(ssl.PROTOCOL_SSLv23) test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries /usr/local/lib/python3.10/dist-packages/_pytest/threadexception.py:73: PytestUnhandledThreadExceptionWarning: Exception in thread Thread-16 (attack) Traceback (most recent call last): File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner self.run() File "/usr/lib/python3.10/threading.py", line 953, in run self._target(*self._args, **self._kwargs) File "/ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/test.py", line 429, in attack cursor.execute(query_pool[query_id].format(random_table_name)) psycopg2.errors.NumericValueOutOfRange: integer out of range warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg)) -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html ============================== slowest durations =============================== 181.67s call test_reload_client_certificate/test.py::test_wrong_cn_cert 173.63s setup test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart 141.65s call test_reload_clusters_config/test.py::test_add_cluster 138.96s call test_reload_clusters_config/test.py::test_delete_cluster 126.35s call test_reload_clusters_config/test.py::test_update_one_cluster 76.71s call test_scheduler/test.py::test_workload_entity_keeper_storage 64.83s call test_reload_clusters_config/test.py::test_simple_reload 64.25s call test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select 62.85s call test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 46.47s call test_replicated_user_defined_functions/test.py::test_reload_zookeeper 44.95s call test_replicated_user_defined_functions/test.py::test_start_without_zookeeper 35.01s call test_scheduler/test.py::test_workload_hierarchy_changes 30.63s setup test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch 30.53s setup test_restore_external_engines/test.py::test_restore_table 27.61s setup test_reload_clusters_config/test.py::test_add_cluster 26.85s call test_reload_client_certificate/test.py::test_correct_cn_cert 25.58s setup test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl 25.52s setup test_scheduler/test.py::test_create_workload 24.38s call test_rocksdb_options/test.py::test_table_invalid_block_based_table_options 23.98s call test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished 23.67s call test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper 23.54s teardown test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore 23.49s setup test_reload_client_certificate/test.py::test_correct_cn_cert 23.33s setup test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 22.96s call test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables 22.87s call test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished 22.63s call test_postgresql_replica_database_engine_1/test.py::test_replicating_dml 22.54s teardown test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 22.46s call test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries 22.46s setup test_rename_column/test.py::test_rename_distributed 22.14s teardown test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy 21.94s teardown test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl 21.93s teardown test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns 21.69s teardown test_scheduler/test.py::test_workload_hierarchy_changes 21.61s teardown test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver] 21.59s teardown test_s3_imds/test_simple.py::test_credentials_from_metadata 21.59s teardown test_s3_latency_log/test.py::test_latency_log 21.48s teardown test_s3_storage_class/test.py::test_s3_storage_class_right 21.47s teardown test_s3_imds/test_session_token.py::test_credentials_from_metadata 21.38s call test_postgresql_replica_database_engine_1/test.py::test_multiple_databases 21.36s setup test_replicated_user_defined_functions/test.py::test_create_and_drop 21.34s teardown test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3] 21.27s teardown test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper 21.26s teardown test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart 21.08s call test_rename_column/test.py::test_rename_distributed 21.05s setup test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper 20.86s call test_rocksdb_options/test.py::test_invalid_options 19.15s call test_rocksdb_options/test.py::test_table_invalid_column_family_options 19.11s setup test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy 19.04s setup test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility 18.98s setup test_postgresql_replica_database_engine_1/test.py::test_different_data_types 18.65s call test_rocksdb_options/test.py::test_table_invalid_options 18.29s call test_s3_latency_log/test.py::test_latency_log 18.09s setup test_s3_low_cardinality_right_border/test.py::test_s3_right_border 17.71s setup test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers 17.09s teardown test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach 17.03s call test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility 16.89s setup test_s3_latency_log/test.py::test_latency_log 16.80s teardown test_reload_client_certificate/test.py::test_wrong_cn_cert 16.71s teardown test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility 16.69s setup test_s3_imds/test_session_token.py::test_credentials_from_metadata 16.32s call test_rocksdb_options/test.py::test_invalid_column_family_options 16.32s call test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes 16.04s setup test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3] 15.84s setup test_s3_storage_class/test.py::test_s3_storage_class_right 15.05s setup test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3] 15.04s call test_scheduler/test.py::test_s3_resource_request_granularity 14.35s call test_restore_external_engines/test.py::test_restore_table_null 14.25s call test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots 14.24s setup test_remote_prewhere/test.py::test_remote 14.22s setup test_rocksdb_options/test.py::test_invalid_block_based_table_options 13.93s call test_postgresql_replica_database_engine_1/test.py::test_single_transaction 13.74s call test_rocksdb_options/test.py::test_invalid_block_based_table_options 13.18s call test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers 12.78s call test_restore_external_engines/test.py::test_restore_table 12.22s call test_postgresql_replica_database_engine_1/test.py::test_different_data_types 12.21s setup test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys 12.01s call test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy 12.00s call test_scheduler/test.py::test_create_workload 11.97s teardown test_reload_clusters_config/test.py::test_update_one_cluster 11.94s setup test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach 11.72s call test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy 11.61s call test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy 11.61s call test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list 11.56s call test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy 11.37s call test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy 11.35s call test_replicated_user_defined_functions/test.py::test_server_restart 11.32s call test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver] 11.26s call test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3] 11.19s setup test_settings_constraints_distributed/test.py::test_insert_clamps_settings 11.12s call test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3] 9.43s setup test_s3_imds/test_simple.py::test_credentials_from_metadata 9.23s teardown test_rename_column/test.py::test_rename_with_parallel_ttl_move 8.76s call test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables 8.61s call test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart 8.36s teardown test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys 7.82s call test_settings_constraints_distributed/test.py::test_select_clamps_settings 6.15s call test_scheduler/test.py::test_mutation_workload_change 6.08s call test_scheduler/test.py::test_merge_workload_change 5.87s teardown test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers 5.72s call test_scheduler/test.py::test_merge_workload_override 5.70s setup test_settings_constraints_distributed/test.py::test_select_clamps_settings 5.66s teardown test_restore_external_engines/test.py::test_restore_table_null 5.60s call test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys 5.59s call test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys 5.58s call test_scheduler/test.py::test_mutation_workload_override 5.07s call test_s3_low_cardinality_right_border/test.py::test_s3_right_border 4.96s call test_scheduler/test.py::test_resource_read_and_write 4.83s teardown test_settings_constraints_distributed/test.py::test_select_clamps_settings 4.68s call test_replicated_user_defined_functions/test.py::test_replication 4.60s call test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index 3.97s call test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12] 3.77s call test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16] 3.38s call test_settings_constraints_distributed/test.py::test_insert_clamps_settings 3.32s teardown test_remote_prewhere/test.py::test_remote 3.25s call test_scheduler/test.py::test_s3_disk 3.09s teardown test_replicated_user_defined_functions/test.py::test_start_without_zookeeper 3.01s call test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch 2.98s call test_postgresql_replica_database_engine_1/test.py::test_virtual_columns 2.73s call test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 2.62s call test_scheduler/test.py::test_merge_workload 2.54s call test_postgresql_replica_database_engine_1/test.py::test_quoting_1 2.48s call test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns 2.45s call test_scheduler/test.py::test_mutate_workload 2.41s call test_replicated_user_defined_functions/test.py::test_create_and_replace 2.40s call test_scheduler/test.py::test_resource_any_disk 2.29s call test_postgresql_replica_database_engine_1/test.py::test_quoting_2 2.28s call test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore 2.11s call test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation 2.07s call test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl 2.05s call test_s3_imds/test_simple.py::test_credentials_from_metadata 2.01s call test_scheduler/test.py::test_throw_on_unknown_workload 1.99s call test_s3_imds/test_session_token.py::test_credentials_from_metadata 1.97s teardown test_postgresql_replica_database_engine_1/test.py::test_virtual_columns 1.89s call test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 1.83s teardown test_postgresql_replica_database_engine_1/test.py::test_multiple_databases 1.78s teardown test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16] 1.69s setup test_scheduler/test.py::test_resource_read_and_write 1.68s teardown test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12] 1.60s setup test_scheduler/test.py::test_resource_any_disk 1.42s teardown test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 1.38s teardown test_postgresql_replica_database_engine_1/test.py::test_single_transaction 1.33s call test_rocksdb_options/test.py::test_valid_options 1.31s teardown test_rocksdb_options/test.py::test_valid_options 1.29s setup test_scheduler/test.py::test_merge_workload_override 1.26s teardown test_postgresql_replica_database_engine_1/test.py::test_replicating_dml 1.22s call test_replicated_user_defined_functions/test.py::test_drop_if_exists 1.17s call test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0] 1.12s teardown test_postgresql_replica_database_engine_1/test.py::test_quoting_1 1.03s teardown test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables 1.02s setup test_scheduler/test.py::test_workload_hierarchy_changes 0.99s teardown test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables 0.99s teardown test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries 0.98s teardown test_postgresql_replica_database_engine_1/test.py::test_quoting_2 0.97s teardown test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished 0.95s setup test_scheduler/test.py::test_mutation_workload_change 0.92s teardown test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index 0.91s teardown test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes 0.88s setup test_scheduler/test.py::test_s3_resource_request_granularity 0.84s setup test_scheduler/test.py::test_workload_entity_keeper_storage 0.84s setup test_scheduler/test.py::test_throw_on_unknown_workload 0.82s setup test_scheduler/test.py::test_s3_disk 0.81s setup test_scheduler/test.py::test_mutate_workload 0.79s setup test_scheduler/test.py::test_merge_workload 0.78s call test_replicated_user_defined_functions/test.py::test_create_and_drop 0.77s setup test_scheduler/test.py::test_mutation_workload_override 0.77s setup test_scheduler/test.py::test_merge_workload_change 0.76s call test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach 0.75s call test_s3_storage_class/test.py::test_s3_storage_class_right 0.74s teardown test_postgresql_replica_database_engine_1/test.py::test_different_data_types 0.74s teardown test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished 0.69s teardown test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots 0.68s call test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1] 0.47s call test_rename_column/test.py::test_rename_with_parallel_ttl_delete 0.42s call test_rename_column/test.py::test_rename_with_parallel_slow_insert 0.37s call test_remote_prewhere/test.py::test_remote 0.32s call test_rename_column/test.py::test_rename_parallel 0.28s call test_rename_column/test.py::test_rename_with_parallel_insert 0.27s call test_rename_column/test.py::test_rename_parallel_same_node 0.27s call test_rocksdb_options/test.py::test_valid_column_family_options 0.27s call test_rocksdb_options/test.py::test_table_valid_column_family_options 0.27s call test_rename_column/test.py::test_rename_with_parallel_ttl_move 0.27s call test_rename_column/test.py::test_rename_with_parallel_select 0.27s call test_rename_column/test.py::test_rename_with_parallel_merges 0.27s call test_rocksdb_options/test.py::test_table_valid_options 0.01s teardown test_reload_clusters_config/test.py::test_add_cluster 0.00s setup test_replicated_user_defined_functions/test.py::test_server_restart 0.00s setup test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16] 0.00s setup test_reload_clusters_config/test.py::test_delete_cluster 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables 0.00s setup test_replicated_user_defined_functions/test.py::test_replication 0.00s teardown test_reload_client_certificate/test.py::test_correct_cn_cert 0.00s teardown test_reload_clusters_config/test.py::test_simple_reload 0.00s teardown test_scheduler/test.py::test_workload_entity_keeper_storage 0.00s teardown test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3] 0.00s teardown test_replicated_user_defined_functions/test.py::test_reload_zookeeper 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_quoting_2 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index 0.00s setup test_rename_column/test.py::test_rename_with_parallel_ttl_delete 0.00s teardown test_scheduler/test.py::test_create_workload 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots 0.00s setup test_replicated_user_defined_functions/test.py::test_create_and_replace 0.00s setup test_rename_column/test.py::test_rename_parallel 0.00s teardown test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy 0.00s setup test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12] 0.00s teardown test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_multiple_databases 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_quoting_1 0.00s teardown test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_replicating_dml 0.00s setup test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list 0.00s teardown test_rename_column/test.py::test_rename_distributed 0.00s setup test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1] 0.00s teardown test_settings_constraints_distributed/test.py::test_insert_clamps_settings 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries 0.00s teardown test_s3_low_cardinality_right_border/test.py::test_s3_right_border 0.00s teardown test_restore_external_engines/test.py::test_restore_table 0.00s teardown test_scheduler/test.py::test_resource_read_and_write 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished 0.00s teardown test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables 0.00s setup test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy 0.00s teardown test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_virtual_columns 0.00s teardown test_rocksdb_options/test.py::test_table_invalid_options 0.00s teardown test_replicated_user_defined_functions/test.py::test_create_and_drop 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_single_transaction 0.00s setup test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0] 0.00s setup test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver] 0.00s setup test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 0.00s setup test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore 0.00s teardown test_scheduler/test.py::test_merge_workload 0.00s setup test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 0.00s teardown test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0] 0.00s teardown test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy 0.00s setup test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys 0.00s setup test_rename_column/test.py::test_rename_with_parallel_slow_insert 0.00s teardown test_rename_column/test.py::test_rename_parallel_same_node 0.00s teardown test_rocksdb_options/test.py::test_table_invalid_block_based_table_options 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes 0.00s setup test_replicated_user_defined_functions/test.py::test_reload_zookeeper 0.00s teardown test_rename_column/test.py::test_rename_with_parallel_insert 0.00s setup test_replicated_user_defined_functions/test.py::test_start_without_zookeeper 0.00s teardown test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy 0.00s setup test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select 0.00s setup test_rocksdb_options/test.py::test_valid_options 0.00s setup test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns 0.00s setup test_reload_client_certificate/test.py::test_wrong_cn_cert 0.00s setup test_rocksdb_options/test.py::test_table_invalid_options 0.00s teardown test_scheduler/test.py::test_resource_any_disk 0.00s setup test_restore_external_engines/test.py::test_restore_table_null 0.00s setup test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy 0.00s setup test_rocksdb_options/test.py::test_table_invalid_column_family_options 0.00s setup test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy 0.00s teardown test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation 0.00s setup test_reload_clusters_config/test.py::test_simple_reload 0.00s setup test_rocksdb_options/test.py::test_table_valid_column_family_options 0.00s teardown test_rocksdb_options/test.py::test_invalid_block_based_table_options 0.00s setup test_rename_column/test.py::test_rename_with_parallel_merges 0.00s setup test_rocksdb_options/test.py::test_table_invalid_block_based_table_options 0.00s setup test_rocksdb_options/test.py::test_table_valid_options 0.00s setup test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation 0.00s setup test_rocksdb_options/test.py::test_valid_column_family_options 0.00s setup test_reload_clusters_config/test.py::test_update_one_cluster 0.00s setup test_replicated_user_defined_functions/test.py::test_drop_if_exists 0.00s setup test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy 0.00s teardown test_scheduler/test.py::test_s3_disk 0.00s teardown test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select 0.00s setup test_rename_column/test.py::test_rename_parallel_same_node 0.00s teardown test_replicated_user_defined_functions/test.py::test_server_restart 0.00s setup test_rocksdb_options/test.py::test_invalid_column_family_options 0.00s teardown test_scheduler/test.py::test_merge_workload_override 0.00s setup test_rename_column/test.py::test_rename_with_parallel_insert 0.00s teardown test_rocksdb_options/test.py::test_invalid_options 0.00s teardown test_rocksdb_options/test.py::test_table_invalid_column_family_options 0.00s teardown test_rocksdb_options/test.py::test_invalid_column_family_options 0.00s setup test_rocksdb_options/test.py::test_invalid_options 0.00s teardown test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 0.00s teardown test_rename_column/test.py::test_rename_parallel 0.00s teardown test_reload_clusters_config/test.py::test_delete_cluster 0.00s teardown test_scheduler/test.py::test_s3_resource_request_granularity 0.00s setup test_rename_column/test.py::test_rename_with_parallel_ttl_move 0.00s setup test_rename_column/test.py::test_rename_with_parallel_select 0.00s teardown test_scheduler/test.py::test_throw_on_unknown_workload 0.00s teardown test_replicated_user_defined_functions/test.py::test_drop_if_exists 0.00s teardown test_rename_column/test.py::test_rename_with_parallel_select 0.00s teardown test_replicated_user_defined_functions/test.py::test_create_and_replace 0.00s teardown test_scheduler/test.py::test_mutation_workload_change 0.00s teardown test_scheduler/test.py::test_merge_workload_change 0.00s teardown test_scheduler/test.py::test_mutate_workload 0.00s teardown test_rename_column/test.py::test_rename_with_parallel_slow_insert 0.00s teardown test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1] 0.00s teardown test_scheduler/test.py::test_mutation_workload_override 0.00s teardown test_rename_column/test.py::test_rename_with_parallel_ttl_delete 0.00s teardown test_replicated_user_defined_functions/test.py::test_replication 0.00s teardown test_rocksdb_options/test.py::test_table_valid_options 0.00s teardown test_rocksdb_options/test.py::test_table_valid_column_family_options 0.00s teardown test_rocksdb_options/test.py::test_valid_column_family_options 0.00s teardown test_rename_column/test.py::test_rename_with_parallel_merges =========================== short test summary info ============================ FAILED test_reload_clusters_config/test.py::test_update_one_cluster - Asserti... PASSED test_replicated_user_defined_functions/test.py::test_create_and_drop PASSED test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1] PASSED test_s3_low_cardinality_right_border/test.py::test_s3_right_border PASSED test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0] PASSED test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 PASSED test_replicated_user_defined_functions/test.py::test_create_and_replace PASSED test_replicated_user_defined_functions/test.py::test_drop_if_exists PASSED test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 PASSED test_rocksdb_options/test.py::test_invalid_block_based_table_options PASSED test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy PASSED test_postgresql_replica_database_engine_1/test.py::test_different_data_types PASSED test_scheduler/test.py::test_create_workload PASSED test_scheduler/test.py::test_merge_workload PASSED test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy PASSED test_rename_column/test.py::test_rename_distributed PASSED test_rocksdb_options/test.py::test_invalid_column_family_options PASSED test_scheduler/test.py::test_merge_workload_change PASSED test_reload_client_certificate/test.py::test_correct_cn_cert PASSED test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list PASSED test_scheduler/test.py::test_merge_workload_override PASSED test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished PASSED test_scheduler/test.py::test_mutate_workload PASSED test_rocksdb_options/test.py::test_invalid_options PASSED test_scheduler/test.py::test_mutation_workload_change PASSED test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables PASSED test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy PASSED test_scheduler/test.py::test_mutation_workload_override PASSED test_replicated_user_defined_functions/test.py::test_reload_zookeeper PASSED test_scheduler/test.py::test_resource_any_disk PASSED test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy PASSED test_replicated_user_defined_functions/test.py::test_replication PASSED test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation PASSED test_scheduler/test.py::test_resource_read_and_write PASSED test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch PASSED test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table PASSED test_scheduler/test.py::test_s3_disk PASSED test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns PASSED test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy PASSED test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables PASSED test_rocksdb_options/test.py::test_table_invalid_block_based_table_options PASSED test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16] PASSED test_replicated_user_defined_functions/test.py::test_server_restart PASSED test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12] PASSED test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore PASSED test_scheduler/test.py::test_s3_resource_request_granularity PASSED test_scheduler/test.py::test_throw_on_unknown_workload PASSED test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select PASSED test_rocksdb_options/test.py::test_table_invalid_column_family_options PASSED test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries PASSED test_rocksdb_options/test.py::test_table_invalid_options PASSED test_rocksdb_options/test.py::test_table_valid_column_family_options PASSED test_rocksdb_options/test.py::test_table_valid_options PASSED test_rocksdb_options/test.py::test_valid_column_family_options PASSED test_rocksdb_options/test.py::test_valid_options PASSED test_postgresql_replica_database_engine_1/test.py::test_multiple_databases PASSED test_replicated_user_defined_functions/test.py::test_start_without_zookeeper PASSED test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3] PASSED test_postgresql_replica_database_engine_1/test.py::test_quoting_1 PASSED test_postgresql_replica_database_engine_1/test.py::test_quoting_2 PASSED test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl PASSED test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index PASSED test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver] PASSED test_restore_external_engines/test.py::test_restore_table PASSED test_settings_constraints_distributed/test.py::test_insert_clamps_settings PASSED test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers PASSED test_s3_latency_log/test.py::test_latency_log PASSED test_restore_external_engines/test.py::test_restore_table_null PASSED test_settings_constraints_distributed/test.py::test_select_clamps_settings PASSED test_reload_clusters_config/test.py::test_add_cluster PASSED test_postgresql_replica_database_engine_1/test.py::test_replicating_dml PASSED test_remote_prewhere/test.py::test_remote PASSED test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach PASSED test_scheduler/test.py::test_workload_entity_keeper_storage PASSED test_s3_imds/test_simple.py::test_credentials_from_metadata PASSED test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished PASSED test_s3_storage_class/test.py::test_s3_storage_class_right PASSED test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility PASSED test_postgresql_replica_database_engine_1/test.py::test_single_transaction PASSED test_s3_imds/test_session_token.py::test_credentials_from_metadata PASSED test_scheduler/test.py::test_workload_hierarchy_changes PASSED test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes PASSED test_reload_client_certificate/test.py::test_wrong_cn_cert PASSED test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots PASSED test_postgresql_replica_database_engine_1/test.py::test_virtual_columns PASSED test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3] PASSED test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys PASSED test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys PASSED test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper PASSED test_reload_clusters_config/test.py::test_delete_cluster PASSED test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart PASSED test_reload_clusters_config/test.py::test_simple_reload SKIPPED [1] test_rename_column/test.py:338: Consume tons of memory with sanitizer SKIPPED [1] test_rename_column/test.py:297: Consume tons of memory with sanitizer SKIPPED [1] test_rename_column/test.py:433: Consume tons of memory with sanitizer SKIPPED [1] test_rename_column/test.py:489: Consume tons of memory with sanitizer SKIPPED [1] test_rename_column/test.py:380: Consume tons of memory with sanitizer SKIPPED [1] test_rename_column/test.py:555: Consume tons of memory with sanitizer SKIPPED [1] test_rename_column/test.py:670: Consume tons of memory with sanitizer SKIPPED [1] test_rename_column/test.py:596: Consume tons of memory with sanitizer ======= 1 failed, 91 passed, 8 skipped, 36 warnings in 513.95s (0:08:33) ======= Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 528, in subprocess.check_call(cmd, shell=True, bufsize=0) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_egzw3g --privileged --dns-search='.' --memory=30709035008 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=8b2301119731 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction test_postgresql_replica_database_engine_1/test.py::test_table_schema_changes test_postgresql_replica_database_engine_1/test.py::test_user_managed_slots test_postgresql_replica_database_engine_1/test.py::test_virtual_columns test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_remote_prewhere/test.py::test_remote test_remove_stale_moving_parts/test.py::test_remove_stale_moving_parts_without_zookeeper test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move test_replicated_merge_tree_compatibility/test.py::test_replicated_merge_tree_defaults_compatibility test_replicated_merge_tree_encrypted_disk/test.py::test_different_keys test_replicated_merge_tree_encrypted_disk/test.py::test_same_keys test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_merge_tree_s3_zero_copy/test.py::test_drop_table 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[0-16]' 'test_replicated_merge_tree_s3_zero_copy/test.py::test_insert_select_replicated[8192-12]' test_replicated_merge_tree_s3_zero_copy/test.py::test_s3_check_restore test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replicated_user_defined_functions/test.py::test_create_and_drop 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[false-expected_raise1]' 'test_replicated_user_defined_functions/test.py::test_create_and_drop_udf_on_cluster[true-expected_raise0]' test_replicated_user_defined_functions/test.py::test_create_and_replace test_replicated_user_defined_functions/test.py::test_drop_if_exists test_replicated_user_defined_functions/test.py::test_reload_zookeeper test_replicated_user_defined_functions/test.py::test_replication test_replicated_user_defined_functions/test.py::test_replication_replace_by_another_node_after_creation test_replicated_user_defined_functions/test.py::test_server_restart test_replicated_user_defined_functions/test.py::test_start_without_zookeeper test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_s3_imds/test_session_token.py::test_credentials_from_metadata test_s3_imds/test_simple.py::test_credentials_from_metadata test_s3_latency_log/test.py::test_latency_log test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_storage_conf_new_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver]' test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_env_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_proxy_list_no_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy test_s3_table_function_with_http_proxy/test.py::test_s3_with_http_remote_proxy_no_proxy test_scheduler/test.py::test_create_workload test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_resource_any_disk test_scheduler/test.py::test_resource_read_and_write test_scheduler/test.py::test_s3_disk test_scheduler/test.py::test_s3_resource_request_granularity test_scheduler/test.py::test_throw_on_unknown_workload test_scheduler/test.py::test_workload_entity_keeper_storage test_scheduler/test.py::test_workload_hierarchy_changes test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings -vvv -ss" altinityinfra/integration-tests-runner:2165613c5fcd ' returned non-zero exit status 1.